building freenas using nanobsd - freebsd.org personal …imp/bsdcan2011-slides.pdf · building...

Building FreeNAS using NanoBSD

Warner [email protected]

The FreeBSD Project

BSDCan 2011 — Ottawa, Canada14 May 2010

http://people.freebsd.org/~imp/bsdcan2011-slides.pdf

Background and ContextNanoBSD Overview

Runtime EnvironmentCase Study – FreeNAS

Build WalkthroughQuestions/Comments

Outline

1 Background and Context

2 NanoBSD Overview

3 Runtime Environment

4 Case Study – FreeNAS

5 Build Walkthrough

Warner Losh Building FreeNAS using NanoBSD




Overview

• Creating FreeBSD images for specialized purposes.

• NanoBSD: goals and non-goals

• NanoBSD new features

• FreeNAS case study





What is NanoBSD

• A shell script

• Builds FreeBSD

• Creates FreeBSD System Tree

• Creates Image for Target Media

• Provides Run–Time Environment Based on Diskless





What is FreeNAS

• FreeBSD–based NAS System

• NanoBSD–based

• Django–based GUI with Mysql Database

• MVC Architecture

• Merges Mysql Database with /etc/rc.conf





Outline


2 NanoBSD Overview



5 Build Walkthrough





NanoBSD Overview

• What is NanoBSD (detailed)

• What NanoBSD isn’t

• Example at end, if time





What is NanoBSD?

• Collection of Metadata

• Shell Script to Build “stuff”

• Standard Scripts for Target

• Customized Files for Target

• Framework





What is Metadata?

• What Architecture to Use

• What Subset of FreeBSD to Build

• What Subset to Install on Image

• What Packages to Install

• How Big to Make Flash

• Overriding Default Behavior

• Other Customization Functions





What is “Stuff”?

• FreeBSD base (src tree, user land and kernel)

• Images of Partitions

• Images of CF/SD/etc cards

• uboot Images

• Administrative Databases

• Your Changes Here





Standard Scripts

• /root/updatep1, /root/updatep2, /root/update

• /root/cfg save

• /root/change password

• /root/save sshkeys





Customizations

• Customization via Shell Script

• Include Trees on Target

• Partition Image

• Memory Disks

• Extra Partitions/FS to Mount





What NanoBSD Isn’t

• Configuration Management System

• Source Code Control

• Build System (limited cases)

• Build Orchestration (limited cases)





Common Uses

• Embedded Boxes

• Appliances

• Jail Factory

• VM maker

• Standardized Test Images





Examples

• FreeNAS

• BSDRP

• Examples from the Studio Audience





9.0 Improvements (some merged)

• Generic Flash

• Better /data Support

• More Configuration Knobs

• Optionally use UFS labels (media independent booting)





Future Improvements

• Package/Ports (maybe 9 with luck)

• Maybe a NanoBSDng?





Outline


2 NanoBSD Overview



5 Build Walkthrough





Process

• NanoBSD Config File

• Build w/NanoBSD

• Boot NanoBSD• Diskless Environment• Read Only Code• Data in RAM• Save to Disk

• Upgrade





Disk Layout

• MBR (4 partitions s1-s4)

• s1 and s2 are system partitions

• s3 is optional configuration data (mostly r/o)

• s4 is optional data (can be r/w)





Diskless Environment

• / read only

• /etc md copied from /conf/base/etc and /cfg

• /var md copied from /conf/base/var

• /mnt md to hold mount points

• /cfg for config (unmounted)

• /data for r/w data





Outline


2 NanoBSD Overview



5 Build Walkthrough





FreeNAS

• NAS Box

• ZFS

• Django GUI with full AJAX

• Back End

• Upgrade via GUI





FreeNAS Build

• Custom Build Script• Checkout FreeBSD src• Checkout FreeBSD ports• Apply patches• Build FreeBSD with NanoBSD

• Custom Packaging Script• Package NanoBSD on LiveCD• Package NanoBSD Update Blobs





FreeNAS Build

• NanoBSD Customizations• Build Packages from Ports (cached)• Build “pure” Database• Support for Cross Building (limited)

• Cross Building• Building i386 on amd64• w/o package cache: arm





FreeNAS GUI

• Django

• Dojango

• lighttpd

• custom backend





FreeNAS Screen Shot





Database

• Mysql Database

• Lives on /data Partition (rw)

• Migrations (up/down grade)

• All admin data here

• Inflexible for experts, easy to update, backup for novice





Backend

• Converts database data to FreeBSD formats

• Shell scripts

• Built into /etc/rc system

• Changes triggered from Django GUI

• Changes triggered from Console Menu GUI





Outline


2 NanoBSD Overview



5 Build Walkthrough





FreeNAS Build and Config files

Repohttps://freenas.svn.sourceforge.net/svnroot/freenas/trunk

Exampleshttp://people.freebsd.org/~imp/bsdcan2011-freenas-common

http://people.freebsd.org/~imp/bsdcan2011-common

http://people.freebsd.org/~imp/bsdcan2011-do-build.sh





Questions? Comments?Warner [email protected]

http://people.freebsd.org/~imp/bsdcan2011-slides.pdf


building freenas using nanobsd - freebsd.org personal …imp/bsdcan2011-slides.pdf · building...

Documents