Hardac

From i3Detroit
Jump to: navigation, search
Hardac
Hardac.png
Name hardac
Zone Infrastructure


Owner i3Detroit
Make Model RAVE Computers
Part Number RR-4U-2630-02-SAS
Date Acquired 2014-10
Storage Location Northmost Media Lab cabinet space
Authorization Required Yes
Status Running
Value $4,770
IP Address 10.13.0.17
MAC Address 0c:c4:7a:18:18:98
Hostname hardac.i3Detroit.local
Documentation Initial quote: File:2014 RAVE Quote.pdf; actual specs below

"Trainers" have sudo privileges; "Authorised users" are user accounts on the machine.

Other References


Intro

Rules

  • Please ask for an account if you think you need one.
    • Chances are you actually want an account on one of the VMs the machine runs instead.

Instructions

Virtual machine control notes

sudo -u vm_host vboxmanage controlvm mcclellan poweroff

sudo -u vm_host vboxmanage modifyvm mcclellan --memory 2048

sudo -u vm_host vboxmanage startvm mcclellan --type headless

IFS=$'\n'; for host in $(sudo -u vm_host vboxmanage list runningvms | cut -f2 -d'"'); do echo "$host:"; sudo -u vm_host vboxmanage showvminfo "$host" | grep VRDE | head -n3; echo ""; done

Remote control

VMs can have VRDE, a fancy word for RDP use `rdesktop`, or you might get bad sizes


Creating a New VM

  • ssh into Hardac. Switch to user vm_host and download your install media.

sudo su - vm_host

cd Downloads

wget https://cdimage.debian.org/debian-cd/current/amd64/iso-cd/debian-10.0.0-amd64-netinst.iso (or whatever the current one is)

cd ../VirtualBox\ VMs/newVM

  • Create the VM and give it some memory, a couple CPUs, and the I/O APIC layer to use them.

VBoxManage createvm --name newVM --ostype Debian --register

VBoxManage modifyvm newVM --memory 1024

VBoxManage modifyvm newVM --cpus 2

VBoxManage modifyvm newVM --ioapic on

  • Set up network adapter.

VBoxManage modifyvm newVM --bridgeadapter1 eth0

VBoxManage modifyvm newVM --nic1 bridged

  • Create a harddisk. Size is in megabytes.

VBoxManage createhd --filename newVM.vdi --size 20000 --format VDI

VBoxManage storagectl newVM --name "SATA Controller" --add sata --controller IntelAhci

VBoxManage storageattach newVM --storagectl "SATA Controller" --port 0 --device 0 --type hdd --medium newVM.vdi

  • Create a DVD drive and mount the install media.

VBoxManage storagectl newVM --name "IDE Controller" --add ide --controller PIIX4

VBoxManage storageattach newVM --storagectl "IDE Controller" --port 1 --device 0 --type dvddrive --medium ~/Downloads/debian-10.0.0-amd64-netinst.iso

  • Enable remote desktop and start the VM.

VBoxManage modifyvm newVM --vrde on

VBoxManage modifyvm newVM --vrdemulticon on --vrdeport 3390

VBoxHeadless --startvm newVM

  • Figure out the IP of the VM. (run VBoxManage showvminfo {{|}} grep MAC and find it in the router.) Make sure your ssh connection has x-forwarding and your client is running an x server (mobaxterm works well on windows). Be logged into Hardac as yourself, not vm_host.

rdesktop 10.13.0.17:3390

  • The debian installer should come up. Follow the instructions. Once it's done and starting to reboot, shut it down (ctrl-C in the session its running in). Eject the installation ISO.

VBoxManage storageattach newVM --storagectl "IDE Controller" --port 1 --device 0 --medium "none"

  • Set it to automatically start, and then start it again,

VBoxManage modifyvm newVM --autostart-enabled On

VBoxManage startvm newVM --type headless

  • Almost done. SSH into it as your user.

su

apt-get install sudo

usermod -aG sudo yourUser

  • Log out and back in. Done!

Maintenance Info

Weekly

  • Check filters for buildup; wash if needed

Usage Notes

It's now running https://etckeeper.branchable.com/

Changes to /etc/ should get autocommitted daily? Better yet, you should commit changes with `sudo etckeeper vcs git diff` and such.

FAQ

ToDo

Authorized Users and Trainers

Trainer Name Certified Date
Amelia Meyer 2015/01/10
Matt Gardeski 2015/01/10
Mara Furland 2016-12-28
Nate Bezanson 2024-07-16
User Name Authorized By Date of Most Recent Training
Amelia Meyer Amelia Meyer 2015/01/10
Matt Gardeski Amelia Meyer 2015/01/10
Mara Furland Amelia Meyer 2016-12-28
Mike Fink ? 2016-02-05
Joe Bender ? 2016-05-13
Evan Allen Mara Furland 2018-08-29
Alec Beardsley Mara Furland
Nate Bezanson Mara Furland 2024-07-16


Hardac Zone: Infrastructure https://www.i3detroit.org/wi/images/3/3f/Authorization_required.svg "/> https://www.i3detroit.org/wiki/Hardac

Specs

  • (1) 4U Open-Bay Rackmount Chassis No-PSU w/Door Filter
  • (1) ATX12V / EPS12V 850W Power Supply 100 - 240 V
  • (1) 24x DVDRW Black SATA
  • (2) WD Red Plus 4TB 5400 RPM SATA III 6Gb/s 3.5" Internal NAS CMR Hard Drive in software raid
  • (1) CacheVault Flash Module
  • (1) Dual Xeon E5-2600v2 C602 Chipset EATX Motherboard
  • (2) Xeon E5-2630 v2 (15M Cache, 2.60-3.10 GHz) 6C/12T 80W
  • (2) 4U Active CPU Heat Sink for X9 Socket R WS
  • (8) 8GB DDR3-1866 ECC REG CL13 DRx8 1.5V (64GB Total)
  • (1) DB9 PORT CROSSED Header to Slot

Build

We have software raid 1 for an effective 4TB storage

The resulting disk space is partitioned thus: 

Disk /dev/md0: 3.7 TiB, 3999550930944 bytes, 7811622912 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: gpt
Disk identifier: F2BAC9EB-4645-4D32-A2EB-4AD04F8373DA

Device         Start        End    Sectors   Size Type
/dev/md0p1      2048  249991167  249989120 119.2G Linux swap
/dev/md0p2 249991168  298819583   48828416  23.3G Linux filesystem
/dev/md0p3 298819584 7811620863 7512801280   3.5T Linux filesystem

  └─md0       9:0    0   3.7T  0 raid1 
    ├─md0p1 259:0    0 119.2G  0 part  
    ├─md0p2 259:1    0  23.3G  0 part  /var/log
    └─md0p3 259:2    0   3.5T  0 part  /

Filesystem

f4b0ba4a-3b4b-4046-a79f-0d9bd17e1c0d is flash drive on an internal USB port, which is mounted at /boot to avoid some grub weirdness that probably doesn't matter anymore 

Disk /dev/sde: 1.9 GiB, 2055208960 bytes, 4014080 sectors
Disk model: Flash Disk      
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x33dc1695

Device     Boot Start     End Sectors  Size Id Type
/dev/sde1  *     2048 4014079 4012032  1.9G 83 Linux

Services

  • Local fileserver over Samba
    • Type \\10.13.0.17\i3fileshare for access.
    • See HOWTO_Connect_to_i3fileshare for further instructions.
    • Please create your own directory and avoid messing with others'
    • This storage is NOT at this time backed up in any way; users are expected to have their own backup solutions for critical data
    • Regularly scanned with clamav; infected files are deleted.
  • TODO: monitoring of TrippLite_UPS
  • Virtual Machines:
Name description Autostart? OS UI Mac ip RDP port Services Notes
Skynet Shell server Yes Debian Wheezy Headless/CLI 08:00:27:e1:db:e0 10.13.0.15 5001
  • Space landing point for SSH
  • Member shell server -- mostly used for IRC connections
 Infrastructure-critical -- Nicht für gefingerpöken
mcclellan-new McclellanIoT stuff Yes Debian Jessie Headless/CLI 08:00:27:7e:08:1e 10.13.0.26 5002 Space automation not covered by hassos like mqtt logging and door control stuff Infrastructure-critical -- Nicht für gefingerpöken
Rostock MAX 3D Printer - Rostock MAX control VM No Debian Sid Local terminal/LXDE 08:00:27:2d:13:6d 10.13.0.156 3389 Runs CURA and has machine settings
Full Spectrum 3D Printer - Full Spectrum Pegasus Touch and Laser_Cutter_-_Full_Spectrum control VM No Microsoft Windows 7, Amelia Meyer's serial Local terminal/Windows 08:00:27:ea:45:01 10.13.0.150 5000 Runs RetinaEngrave3D and RetinaCreate
minecraft-new minecraft yes ??? ??? 08:00:27:6b:5b:55 10.13.0.24 5002 minecraft
wheatley ? no ??? ??? 08:00:27:5b:3e:dd 10.13.0.23
marvin ? no ??? ??? 08:00:27:89:9e:ce 10.13.0.25
viki drone worker yes ??? ??? 08:00:27:7e:77:54 10.13.0.12 3390 Infrastructure-critical -- Nicht für gefingerpöken
hassos homeassistant yes hassos web ui 08:00:27:f9:fe:61 10.13.0.22 3391 Infrastructure-critical -- Nicht für gefingerpöken
hassos-new homeassistant yes hassos web ui 08:00:27:f9:fe:62 ? 3392 Infrastructure-critical -- Nicht für gefingerpöken


Power Use

Google Sheets

From Matt Gardeski: These are all estimates based on measurements of equivalent parts. If someone wants to do some actual measurements on the hardware we're running, please do. I think the MARS box and the HP have power monitoring built in to the server management hardware.

RR-4U-I3D-2630-01 n watts under load Idle
(1) ATX12V / EPS12V 850W Power Supply 100 - 240 V 1 50 50 75 75 est.
(4) 2TB Constellation ES.3 7200RPM SATA 6Gb/s 128MB Cache 3.5" HDD 4 27 108 6.5 26
(1) MegaRAID SAS 9361-8i LSI 3108 1GB Cache RAID 0/1/5/6/10/50/60 1 16 16 16 16
(1) ATX C602 LGA2011 Motherboard 2xNIC IPMI 1 20 20 15 15 est.
(1) Xeon E5-2630 v2 (15M Cache, 2.60-3.10 GHz) 6C/12T 80W 1 80 80 40 40
(1) 4U Active CPU Heat Sink for X9 Socket R WS 1 10 10 10 10 est.
(8) 8GB DDR3-1866 ECC REG CL13 DRx8 1.5V (64GB Total) 8 8 64 4 32
watts under load 375 idle watts 120 measured
Things that are going away:
HP DL380 G5 -500 -330
Cisco MARS 110 -500 -400
wattage saved 555
monthly power bill reduction (13c/kWh) 51.95
Months until complete payback in power bill (assuming 13c/kWh) 76
6.333333333
Retrieved from "https://www.i3detroit.org/wi/index.php?title=Hardac&oldid=31940"