Hardac
Hardac | |
---|---|
![]() | |
Name | hardac |
Zone | Infrastructure
|
Owner | i3Detroit |
Make Model | RAVE Computers |
Part Number | RR-4U-2630-02-SAS |
Date Acquired | 2014-10 |
Storage Location | Northmost Media Lab cabinet space |
Authorization Required | Yes |
Status | Running |
Value | $4,770 |
IP Address | 10.13.0.17 |
MAC Address | 0c:c4:7a:18:18:98 |
Hostname | hardac.i3Detroit.local |
Documentation | Initial quote: File:2014 RAVE Quote.pdf; actual specs below
LSI MegaRAID SAS utility documentation "Trainers" have sudo privileges; "Authorised users" are user accounts on the machine. |
Other References |
Contents
Intro
Rules
- Please ask for an account if you think you need one.
- Chances are you actually want an account on one of the VMs the machine runs instead.
Instructions
Virtual machine control notes
sudo -u vm_host vboxmanage controlvm mcclellan poweroff
sudo -u vm_host vboxmanage modifyvm mcclellan --memory 2048
sudo -u vm_host vboxmanage startvm mcclellan --type headless
IFS=$'\n'; for host in $(sudo -u vm_host vboxmanage list runningvms | cut -f2 -d'"'); do echo "$host:"; sudo -u vm_host vboxmanage showvminfo "$host" | grep VRDE | head -n3; echo ""; done
Creating a New VM
- ssh into Hardac. Switch to user vm_host and download your install media.
sudo su - vm_host
cd Downloads
wget https://cdimage.debian.org/debian-cd/current/amd64/iso-cd/debian-10.0.0-amd64-netinst.iso (or whatever the current one is)
cd ../VirtualBox\ VMs/newVM
- Create the VM and give it some memory, a couple CPUs, and the I/O APIC layer to use them.
VBoxManage createvm --name newVM --ostype Debian --register
VBoxManage modifyvm newVM --memory 1024
VBoxManage modifyvm newVM --cpus 2
VBoxManage modifyvm newVM --ioapic on
- Set up network adapter.
VBoxManage modifyvm newVM --bridgeadapter1 eth0
VBoxManage modifyvm newVM --nic1 bridged
- Create a harddisk. Size is in megabytes.
VBoxManage createhd --filename newVM.vdi --size 20000 --format VDI
VBoxManage storagectl newVM --name "SATA Controller" --add sata --controller IntelAhci
VBoxManage storageattach newVM --storagectl "SATA Controller" --port 0 --device 0 --type hdd --medium newVM.vdi
- Create a DVD drive and mount the install media.
VBoxManage storagectl newVM --name "IDE Controller" --add ide --controller PIIX4
VBoxManage storageattach newVM --storagectl "IDE Controller" --port 1 --device 0 --type dvddrive --medium ~/Downloads/debian-10.0.0-amd64-netinst.iso
- Enable remote desktop and start the VM.
VBoxManage modifyvm newVM --vrde on
VBoxManage modifyvm newVM --vrdemulticon on --vrdeport 3390
VBoxHeadless --startvm newVM
- Figure out the IP of the VM. (run VBoxManage showvminfo {{|}} grep MAC and find it in the router.) Make sure your ssh connection has x-forwarding and your client is running an x server (mobaxterm works well on windows). Be logged into Hardac as yourself, not vm_host.
rdesktop 10.13.0.17:3390
- The debian installer should come up. Follow the instructions. Once it's done and starting to reboot, shut it down (ctrl-C in the session its running in). Eject the installation ISO.
VBoxManage storageattach newVM --storagectl "IDE Controller" --port 1 --device 0 --medium "none"
- Set it to automatically start, and then start it again,
VBoxManage modifyvm newVM --autostart-enabled On
VBoxManage startvm newVM --type headless
- Almost done. SSH into it as your user.
su
apt-get install sudo
usermod -aG sudo yourUser
- Log out and back in. Done!
Maintenance Info
Weekly
- Check filters for buildup; wash if needed
Usage Notes
It's now running https://etckeeper.branchable.com/
Changes to /etc/ should get autocommitted daily? Better yet, you should commit changes with `sudo etckeeper vcs git diff` and such.
FAQ
ToDo
Authorized Users and Trainers
Trainer Name | Certified Date |
---|---|
Amelia Meyer | 2015/01/10 |
Matt Gardeski | 2015/01/10 |
Mark Furland | 2016-12-28 |
User Name | Authorized By | Date of Most Recent Training |
---|---|---|
Amelia Meyer | Amelia Meyer | 2015/01/10 |
Matt Gardeski | Amelia Meyer | 2015/01/10 |
Mark Furland | Amelia Meyer | 2016-12-28 |
Mike Fink | ? | 2016-02-05 |
Joe Bender | ? | 2016-05-13 |
Evan Allen | Mark Furland | 2018-08-29 |
Alec Beardsley | Mark Furland |
Specs
- (1) 4U Open-Bay Rackmount Chassis No-PSU w/Door Filter
- (1) ATX12V / EPS12V 850W Power Supply 100 - 240 V
- (1) 24x DVDRW Black SATA
- (4) 2TB Constellation ES.3 7200RPM SAS 6Gb/s 128MB Cache 3.5" HDD
- (1) MegaRAID SAS 9361-8i LSI 3108 1GB Cache RAID 0/1/5/6/10/50/60
- (1) CacheVault Flash Module
- (1) Dual Xeon E5-2600v2 C602 Chipset EATX Motherboard
- (2) Xeon E5-2630 v2 (15M Cache, 2.60-3.10 GHz) 6C/12T 80W
- (2) 4U Active CPU Heat Sink for X9 Socket R WS
- (8) 8GB DDR3-1866 ECC REG CL13 DRx8 1.5V (64GB Total)
- (1) DB9 PORT CROSSED Header to Slot
Build
The MegaRAID SAS controller uses the (4) 2TB drives in a RAID6, for an effective 4TB live storage with 2-drive redundancy.
The resulting disk space is partitioned thus:
Model: LSI MR9361-8i (scsi) Disk /dev/sda: 4000GB Sector size (logical/physical): 512B/512B Partition Table: gpt Number Start End Size File system Name Flags 1 1049kB 128GB 128GB linux-swap(v1) swap 2 128GB 153GB 25.0GB ext4 logs 3 153GB 4000GB 3847GB ext4 root boot
Partition 2, named "logs", is mounted at /var/logs
to prevent any issues down the road with overflowing logs.
Good documentation on the LSI MegaCli64 binary in /usr/sbin
. This comes up because apparently the MR9361-8i occasionally has issues with things like automatically rebuilding an array after a drive is removed and replaced.
Filesystem
9bc4fdb4-a34a-4e17-bb81-fa1d9cb271bd
is an 8GB SanDisk Cruzer Fit in a rear USB port, which is mounted at /boot
to avoid the GRUB weirdness we have been enjoying for a year now.
Model: SanDisk Cruzer Fit (scsi) Disk /dev/sdd: 8003MB Sector size (logical/physical): 512B/512B Partition Table: msdos Disk Flags: Number Start End Size Type File system Flags 1 1049kB 8003MB 8002MB primary ext2 boot, lba
Services
- Local fileserver over Samba
- Type
\\10.13.0.17\i3fileshare
for access. - See HOWTO_Connect_to_i3fileshare for further instructions.
- Please create your own directory and avoid messing with others'
- This storage is NOT at this time backed up in any way; users are expected to have their own backup solutions for critical data
- Regularly scanned with clamav; infected files are deleted.
- Type
- TODO: monitoring of TrippLite_UPS
- Virtual Machines:
Name | description | Autostart? | OS | UI | RDP port | Services | Notes |
---|---|---|---|---|---|---|---|
Asterisk | Asterisk phone voip stuff | Yes | Debian Wheezy | Headless/CLI | none | Runs the phones | Infrastructure-critical -- Nicht für gefingerpöken |
Skynet | Shell server | Yes | Debian Wheezy | Headless/CLI | 5001 |
|
Infrastructure-critical -- Nicht für gefingerpöken |
mcclellan-new | McclellanIoT stuff | Yes | Debian Jessie | Headless/CLI | 5002 | Space automation not covered by hassos like mqtt logging and door control stuff | Infrastructure-critical -- Nicht für gefingerpöken |
Rostock MAX | 3D Printer - Rostock MAX control VM | No | Debian Sid | Local terminal/LXDE | 3389 | Runs CURA and has machine settings | |
Full Spectrum | 3D Printer - Full Spectrum Pegasus Touch and Laser_Cutter_-_Full_Spectrum control VM | No | Microsoft Windows 7, Amelia Meyer's serial | Local terminal/Windows | 5000 | Runs RetinaEngrave3D and RetinaCreate | |
minecraft-new | minecraft | yes | ??? | ??? | 5002 | minecraft | |
wheatley | ? | no | ??? | ??? | |||
marvin | ? | no | ??? | ??? | |||
viki | done/salt worker | yes | ??? | ??? | 3390 | Infrastructure-critical -- Nicht für gefingerpöken | |
hassos | homeassistant | yes | hassos debian | web ui | none | Infrastructure-critical -- Nicht für gefingerpöken |
Power Use
From Matt Gardeski: These are all estimates based on measurements of equivalent parts. If someone wants to do some actual measurements on the hardware we're running, please do. I think the MARS box and the HP have power monitoring built in to the server management hardware.
RR-4U-I3D-2630-01 | n | watts under load | Idle | |||
---|---|---|---|---|---|---|
(1) ATX12V / EPS12V 850W Power Supply 100 - 240 V | 1 | 50 | 50 | 75 | 75 | est. |
(4) 2TB Constellation ES.3 7200RPM SATA 6Gb/s 128MB Cache 3.5" HDD | 4 | 27 | 108 | 6.5 | 26 | |
(1) MegaRAID SAS 9361-8i LSI 3108 1GB Cache RAID 0/1/5/6/10/50/60 | 1 | 16 | 16 | 16 | 16 | |
(1) ATX C602 LGA2011 Motherboard 2xNIC IPMI | 1 | 20 | 20 | 15 | 15 | est. |
(1) Xeon E5-2630 v2 (15M Cache, 2.60-3.10 GHz) 6C/12T 80W | 1 | 80 | 80 | 40 | 40 | |
(1) 4U Active CPU Heat Sink for X9 Socket R WS | 1 | 10 | 10 | 10 | 10 | est. |
(8) 8GB DDR3-1866 ECC REG CL13 DRx8 1.5V (64GB Total) | 8 | 8 | 64 | 4 | 32 | |
watts under load | 375 | idle watts | 120 | measured | ||
Things that are going away: | ||||||
HP DL380 G5 | -500 | -330 | ||||
Cisco MARS 110 | -500 | -400 | ||||
wattage saved | 555 | |||||
monthly power bill reduction (13c/kWh) | 51.95 | |||||
Months until complete payback in power bill (assuming 13c/kWh) | 76 | |||||
6.333333333 |