2024-01-05 19:37:21 -07:00
|
|
|
<!DOCTYPE html>
|
|
|
|
|
<html lang="en">
|
2024-04-02 21:13:07 -06:00
|
|
|
|
|
|
|
|
<head>
|
|
|
|
|
<title>xbazzi.com</title>
|
|
|
|
|
<meta charset="UTF-8">
|
|
|
|
|
<meta name="viewport" content="width=device-width, initial-scale=1.0">
|
|
|
|
|
<link rel="stylesheet" href="assets/style/style.css">
|
|
|
|
|
<script src="assets/scripts/footer.js"></script>
|
|
|
|
|
<script src="assets/scripts/rss.js"></script>
|
|
|
|
|
<script src="assets/scripts/aside.js"></script>
|
|
|
|
|
<link rel="icon" href="/assets/images/fav.gif" type="image/gif">
|
|
|
|
|
</head>
|
|
|
|
|
|
|
|
|
|
<body>
|
|
|
|
|
<div id="container">
|
2024-04-10 22:38:07 -06:00
|
|
|
<a href="https://www.xbazzi.com"><div class="topbar" ></div></a>
|
2024-04-02 21:13:07 -06:00
|
|
|
<div id="flex">
|
|
|
|
|
<main>
|
|
|
|
|
<div class="wrapper">
|
|
|
|
|
<div class="title" style="font-style: italic;">
|
|
|
|
|
<a href="index.html">../</a>
|
|
|
|
|
homenetwork.html
|
2024-01-05 19:37:21 -07:00
|
|
|
</div>
|
2024-04-02 21:13:07 -06:00
|
|
|
<div class="content">
|
|
|
|
|
<h1>Datacenter at Home</h1>
|
|
|
|
|
<div class="author">Written by Xander Bazzi on 24-03-12.</div>
|
|
|
|
|
<br>
|
|
|
|
|
Embarking on a homelab journey often starts with a spark of curiosity and a dash of ambition.
|
|
|
|
|
At first, my idea was to host my own NAS so that I could unmarry from the cloud; however, this
|
|
|
|
|
quickly evolved
|
|
|
|
|
into a multi-server rack with enterprise-level configuration and security.
|
|
|
|
|
This transformation
|
|
|
|
|
wasn't just about growth in scale; it was about creating a robust infrastructure capable of
|
2024-04-10 22:38:07 -06:00
|
|
|
supporting my day-to-day digital needs with resilience and efficiency.
|
|
|
|
|
|
2024-04-02 21:13:07 -06:00
|
|
|
<br>
|
|
|
|
|
<br>
|
|
|
|
|
|
2024-04-10 22:38:07 -06:00
|
|
|
At the core of the setup are 3 physical servers, each running Proxmox Virtual Environment,
|
|
|
|
|
which is a versatile linux-based hypervisor that underpins the entire virtualization framework.
|
|
|
|
|
All services and workflows run on
|
|
|
|
|
VMs hosted on the 3 PVE physical servers. Three of these VMs (one in each server) act as master nodes
|
|
|
|
|
for my k3s cluster; all other VMs are either running appliances or dedicated services.
|
|
|
|
|
Two of the servers are actually second-hand Lenovo Ultra Small Form Factor PCs, and the third one is built from scratch with a Supermicro board.
|
|
|
|
|
The latter runs a TrueNAS VM, and sports a 6-drive HDD bay, providing plenty of storage for all my workloads.
|
|
|
|
|
Since TrueNAS operates with the ZFS file system,
|
2024-04-02 21:13:07 -06:00
|
|
|
it needs direct access to the disks in order to read the SATA metadata; Proxmox facilitates this with physical disk passthrough.
|
2024-04-10 22:38:07 -06:00
|
|
|
The main storage pools are supplemented by a 500 GB NVMe SSD as an L2 cache and
|
|
|
|
|
64 GB of RAM for L1 caching. If some data in a pool gets enough hits, it gets cached in RAM, allowing
|
|
|
|
|
for the full saturation of the 10Gbps line during intensive data
|
|
|
|
|
transfer operations.
|
|
|
|
|
Proxmox also supports direct PCI passthrough if I decide to get a dedicated GPU for encoding or AI workloads.
|
2024-05-22 21:32:33 -06:00
|
|
|
<br>
|
|
|
|
|
<br>
|
|
|
|
|
Inspired by the <a href="https://wiki.eth0.nl/index.php/LackRack">LackRack</a>, here's a picture of the "enterprise-level"
|
|
|
|
|
physical infrastructure:
|
2024-04-02 21:13:07 -06:00
|
|
|
<br>
|
|
|
|
|
<br>
|
|
|
|
|
<a href="assets/img/dc1.JPG"><img src="assets/img/dc1.JPG" class="blog-image"></a>
|
|
|
|
|
<br>
|
|
|
|
|
|
2024-04-10 22:38:07 -06:00
|
|
|
The network is managed by a virtualized OPNsense appliance with 3 interfaces (2x10gbps SFP+ and 1x1000BASE-T) for WAN, LAN, and DMZ
|
|
|
|
|
traffic.
|
2024-05-22 21:32:33 -06:00
|
|
|
Logically, the network is segmented by a Juniper EX3300 switch, with 48 1000BASE-T ports and 4x SFP+ ports.
|
|
|
|
|
Every server is equipped with 10Gbps SFP+ NICs, connected to the switch with Direct Attach Copper cables,
|
|
|
|
|
yielding theoretical data transfer speeds of up to 10Gbps within the LAN.
|
2024-04-02 21:13:07 -06:00
|
|
|
|
|
|
|
|
<br>
|
|
|
|
|
<br>
|
|
|
|
|
<a href="assets/img/dc2.JPG"><img src="assets/img/dc2.JPG" class="blog-image"></a>
|
|
|
|
|
<br>
|
|
|
|
|
<br>
|
|
|
|
|
|
2024-04-10 22:38:07 -06:00
|
|
|
When trying to install PVE in the Supermicro server, I noticed that the only way to output video
|
|
|
|
|
in the X11SSM board is via a VGA cable. However, the board does come equipped with a
|
|
|
|
|
BMC chip, allowing for remote control of the server through the IPMI interface.
|
|
|
|
|
The inclusion of IPMI is common for server motherboards, as it allows for bare-metal, GUI remote management over Ethernet.
|
|
|
|
|
|
2024-04-02 21:13:07 -06:00
|
|
|
<br>
|
|
|
|
|
<br>
|
|
|
|
|
<a href="assets/img/mb1.JPG"><img src="assets/img/mb1.JPG" class="blog-image"></a>
|
|
|
|
|
<br>
|
|
|
|
|
<br>
|
|
|
|
|
|
2024-07-03 20:01:16 -06:00
|
|
|
As evidenced in the logical diagram below, the on-premises network is not just a standalone hyperconverged
|
2024-04-10 22:38:07 -06:00
|
|
|
infrastructure, but
|
|
|
|
|
a node within a larger network of services, benefiting from the robustness and
|
2024-04-02 21:13:07 -06:00
|
|
|
scalability of cloud solutions while maintaining the personalization and control of a private
|
2024-04-10 22:38:07 -06:00
|
|
|
environment.
|
2024-04-02 21:13:07 -06:00
|
|
|
<br>
|
|
|
|
|
<br>
|
|
|
|
|
<a href="assets/img/homelab_logical.png"><img src="assets/img/homelab_logical.png"
|
|
|
|
|
class="blog-image"></a>
|
|
|
|
|
<br>
|
|
|
|
|
<br>
|
2024-01-05 19:37:21 -07:00
|
|
|
|
2024-04-10 22:38:07 -06:00
|
|
|
This homelab is more than just a collection of hardware and software; it's an interconnected technology stack
|
2024-04-02 21:13:07 -06:00
|
|
|
that balances performance, security, and scalability. It represents the culmination of a journey
|
|
|
|
|
from curiosity to critical infrastructure, demonstrating the power of modern virtualization,
|
2024-04-10 22:38:07 -06:00
|
|
|
networking, and storage solutions.
|
2024-04-02 21:13:07 -06:00
|
|
|
|
|
|
|
|
<br>
|
|
|
|
|
<br>
|
|
|
|
|
A home datacenter is what most Americans deserve, but don't need.
|
|
|
|
|
</p>
|
|
|
|
|
</div>
|
|
|
|
|
</div>
|
|
|
|
|
|
|
|
|
|
</main>
|
2024-03-12 20:18:14 -06:00
|
|
|
|
2024-01-05 19:37:21 -07:00
|
|
|
</div>
|
2024-04-02 21:13:07 -06:00
|
|
|
<footer id="footer"></footer>
|
|
|
|
|
</div>
|
|
|
|
|
<style>
|
|
|
|
|
main {
|
|
|
|
|
background-color: transparent !important;
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
.content {
|
|
|
|
|
background-color: var(--background);
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
.title {
|
|
|
|
|
margin-top: var(--content-spacing);
|
|
|
|
|
}
|
|
|
|
|
|
|
|
|
|
.title:first-child {
|
|
|
|
|
margin-top: 0 !important;
|
|
|
|
|
}
|
|
|
|
|
</style>
|
|
|
|
|
|
|
|
|
|
</body>
|
|
|
|
|
|
|
|
|
|
</html>
|
