Hardac

From i3Detroit
Jump to: navigation, search
Hardac
Hardac.png
Name hardac
Zone Infrastructure


Owner i3Detroit
Make Model RAVE Computers
Part Number RR-4U-2630-02-SAS
Date Acquired 2014-10
Storage Location Northmost Media Lab cabinet space
Authorization Required Yes
Status Running
Value $4,770
IP Address 10.13.0.17
MAC Address 0c:c4:7a:18:18:98
Hostname hardac.i3Detroit.local
Documentation Initial quote: File:2014 RAVE Quote.pdf; actual specs below

LSI MegaRAID SAS utility documentation

"Trainers" have sudo privileges; "Authorised users" are user accounts on the machine.

Other References


Intro

Rules

  • Please ask for an account if you think you need one.
    • Chances are you actually want an account on one of the VMs the machine runs instead.

Instructions

Virtual machine control notes

sudo -u vm_host vboxmanage controlvm mcclellan poweroff

sudo -u vm_host vboxmanage modifyvm mcclellan --memory 2048

sudo -u vm_host vboxmanage startvm mcclellan --type headless

IFS=$'\n'; for host in $(sudo -u vm_host vboxmanage list runningvms | cut -f2 -d'"'); do echo "$host:"; sudo -u vm_host vboxmanage showvminfo "$host" | grep VRDE | head -n3; echo ""; done

Creating a New VM

  • ssh into Hardac. Switch to user vm_host and download your install media.

sudo su - vm_host

cd Downloads

wget https://cdimage.debian.org/debian-cd/current/amd64/iso-cd/debian-10.0.0-amd64-netinst.iso (or whatever the current one is)

cd ../VirtualBox\ VMs/newVM

  • Create the VM and give it some memory, a couple CPUs, and the I/O APIC layer to use them.

VBoxManage createvm --name newVM --ostype Debian --register

VBoxManage modifyvm newVM --memory 1024

VBoxManage modifyvm newVM --cpus 2

VBoxManage modifyvm newVM --ioapic on

  • Set up network adapter.

VBoxManage modifyvm newVM --bridgeadapter1 eth0

VBoxManage modifyvm newVM --nic1 bridged

  • Create a harddisk. Size is in megabytes.

VBoxManage createhd --filename newVM.vdi --size 20000 --format VDI

VBoxManage storagectl newVM --name "SATA Controller" --add sata --controller IntelAhci

VBoxManage storageattach newVM --storagectl "SATA Controller" --port 0 --device 0 --type hdd --medium newVM.vdi

  • Create a DVD drive and mount the install media.

VBoxManage storagectl newVM --name "IDE Controller" --add ide --controller PIIX4

VBoxManage storageattach newVM --storagectl "IDE Controller" --port 1 --device 0 --type dvddrive --medium ~/Downloads/debian-10.0.0-amd64-netinst.iso

  • Enable remote desktop and start the VM.

VBoxManage modifyvm newVM --vrde on

VBoxManage modifyvm newVM --vrdemulticon on --vrdeport 3390

VBoxHeadless --startvm newVM

  • Figure out the IP of the VM. (run VBoxManage showvminfo {{|}} grep MAC and find it in the router.) Make sure your ssh connection has x-forwarding and your client is running an x server (mobaxterm works well on windows). Be logged into Hardac as yourself, not vm_host.

rdesktop 10.13.0.17:3390

  • The debian installer should come up. Follow the instructions. Once it's done and starting to reboot, shut it down (ctrl-C in the session its running in). Eject the installation ISO.

VBoxManage storageattach newVM --storagectl "IDE Controller" --port 1 --device 0 --medium "none"

  • Set it to automatically start, and then start it again,

VBoxManage modifyvm newVM --autostart-enabled On

VBoxManage startvm newVM --type headless

  • Almost done. SSH into it as your user.

su

apt-get install sudo

usermod -aG sudo yourUser

  • Log out and back in. Done!

Maintenance Info

Weekly

  • Check filters for buildup; wash if needed

Usage Notes

It's now running https://etckeeper.branchable.com/

Changes to /etc/ should get autocommitted daily? Better yet, you should commit changes with `sudo etckeeper vcs git diff` and such.

FAQ

ToDo

Authorized Users and Trainers

Trainer Name Certified Date
Amelia Meyer 2015/01/10
Matt Gardeski 2015/01/10
Mark Furland 2016-12-28
User Name Authorized By Date of Most Recent Training
Amelia Meyer Amelia Meyer 2015/01/10
Matt Gardeski Amelia Meyer 2015/01/10
Mark Furland Amelia Meyer 2016-12-28
Mike Fink ? 2016-02-05
Joe Bender ? 2016-05-13
Evan Allen Mark Furland 2018-08-29
Alec Beardsley Mark Furland


Hardac Zone: Infrastructure https://wiki.pumpingstationone.org/images/Authorization_required.svg "/> https://www.i3detroit.org/wiki/Hardac

Specs

  • (1) 4U Open-Bay Rackmount Chassis No-PSU w/Door Filter
  • (1) ATX12V / EPS12V 850W Power Supply 100 - 240 V
  • (1) 24x DVDRW Black SATA
  • (4) 2TB Constellation ES.3 7200RPM SAS 6Gb/s 128MB Cache 3.5" HDD
  • (1) MegaRAID SAS 9361-8i LSI 3108 1GB Cache RAID 0/1/5/6/10/50/60
  • (1) CacheVault Flash Module
  • (1) Dual Xeon E5-2600v2 C602 Chipset EATX Motherboard
  • (2) Xeon E5-2630 v2 (15M Cache, 2.60-3.10 GHz) 6C/12T 80W
  • (2) 4U Active CPU Heat Sink for X9 Socket R WS
  • (8) 8GB DDR3-1866 ECC REG CL13 DRx8 1.5V (64GB Total)
  • (1) DB9 PORT CROSSED Header to Slot

Build

The MegaRAID SAS controller uses the (4) 2TB drives in a RAID6, for an effective 4TB live storage with 2-drive redundancy.

The resulting disk space is partitioned thus: 

Model: LSI MR9361-8i (scsi)
Disk /dev/sda: 4000GB
Sector size (logical/physical): 512B/512B
Partition Table: gpt

Number  Start   End     Size    File system     Name  Flags
 1      1049kB  128GB   128GB   linux-swap(v1)  swap
 2      128GB   153GB   25.0GB  ext4            logs
 3      153GB   4000GB  3847GB  ext4            root  boot

Partition 2, named "logs", is mounted at /var/logs to prevent any issues down the road with overflowing logs.

Good documentation on the LSI MegaCli64 binary in /usr/sbin. This comes up because apparently the MR9361-8i occasionally has issues with things like automatically rebuilding an array after a drive is removed and replaced.

Filesystem

9bc4fdb4-a34a-4e17-bb81-fa1d9cb271bd is an 8GB SanDisk Cruzer Fit in a rear USB port, which is mounted at /boot to avoid the GRUB weirdness we have been enjoying for a year now. 

Model: SanDisk Cruzer Fit (scsi)
Disk /dev/sdd: 8003MB
Sector size (logical/physical): 512B/512B
Partition Table: msdos
Disk Flags:

Number  Start   End     Size    Type     File system  Flags
 1      1049kB  8003MB  8002MB  primary  ext2         boot, lba

Services

  • Local fileserver over Samba
    • Type \\10.13.0.17\i3fileshare for access.
    • See HOWTO_Connect_to_i3fileshare for further instructions.
    • Please create your own directory and avoid messing with others'
    • This storage is NOT at this time backed up in any way; users are expected to have their own backup solutions for critical data
    • Regularly scanned with clamav; infected files are deleted.
  • TODO: monitoring of TrippLite_UPS
  • Virtual Machines:
Name description Autostart? OS UI RDP port Services Notes
Asterisk Asterisk phone voip stuff Yes Debian Wheezy Headless/CLI none Runs the phones Infrastructure-critical -- Nicht für gefingerpöken
Skynet Shell server Yes Debian Wheezy Headless/CLI 5001
  • Space landing point for SSH
  • Member shell server -- mostly used for IRC connections
 Infrastructure-critical -- Nicht für gefingerpöken
mcclellan-new McclellanIoT stuff Yes Debian Jessie Headless/CLI 5002 Space automation not covered by hassos like mqtt logging and door control stuff Infrastructure-critical -- Nicht für gefingerpöken
Rostock MAX 3D Printer - Rostock MAX control VM No Debian Sid Local terminal/LXDE 3389 Runs CURA and has machine settings
Full Spectrum 3D Printer - Full Spectrum Pegasus Touch and Laser_Cutter_-_Full_Spectrum control VM No Microsoft Windows 7, Amelia Meyer's serial Local terminal/Windows 5000 Runs RetinaEngrave3D and RetinaCreate
minecraft-new minecraft yes ??? ??? 5002 minecraft
wheatley ? no ??? ???
marvin ? no ??? ???
viki done/salt worker yes ??? ??? 3390 Infrastructure-critical -- Nicht für gefingerpöken
hassos homeassistant yes hassos debian web ui none Infrastructure-critical -- Nicht für gefingerpöken


Power Use

Google Sheets

From Matt Gardeski: These are all estimates based on measurements of equivalent parts. If someone wants to do some actual measurements on the hardware we're running, please do. I think the MARS box and the HP have power monitoring built in to the server management hardware.

RR-4U-I3D-2630-01 n watts under load Idle
(1) ATX12V / EPS12V 850W Power Supply 100 - 240 V 1 50 50 75 75 est.
(4) 2TB Constellation ES.3 7200RPM SATA 6Gb/s 128MB Cache 3.5" HDD 4 27 108 6.5 26
(1) MegaRAID SAS 9361-8i LSI 3108 1GB Cache RAID 0/1/5/6/10/50/60 1 16 16 16 16
(1) ATX C602 LGA2011 Motherboard 2xNIC IPMI 1 20 20 15 15 est.
(1) Xeon E5-2630 v2 (15M Cache, 2.60-3.10 GHz) 6C/12T 80W 1 80 80 40 40
(1) 4U Active CPU Heat Sink for X9 Socket R WS 1 10 10 10 10 est.
(8) 8GB DDR3-1866 ECC REG CL13 DRx8 1.5V (64GB Total) 8 8 64 4 32
watts under load 375 idle watts 120 measured
Things that are going away:
HP DL380 G5 -500 -330
Cisco MARS 110 -500 -400
wattage saved 555
monthly power bill reduction (13c/kWh) 51.95
Months until complete payback in power bill (assuming 13c/kWh) 76
6.333333333
Retrieved from "https://www.i3detroit.org/wi/index.php?title=Hardac&oldid=29611"