/maddog-3-in-1 by Matt Hudson

Would Christ Have Come To POSSCON?

Free Software The Story: From The Beginning Through Today by Jon "maddog" Hall Executive Director Linux International

Free Software The Story: From The Beginning Through Today...and Into the Future! by Jon "maddog" Hall Executive Director Linux International

Trademarks ●

Linux is a trademark of Linus Torvalds in several countries

●

GNU is a trademark of the Free Software Foundation

●

Unix is a trademark of X/Open in several countries

This Is Me ....and Why You Should Listen. ●

●

Forty-two years in the computer industry –

Mainframes 5 years

–

Unix 20 years

–

Linux since 1994

Programmer, Systems Administrator, Systems Engineer, Product Manager, Technical Marketing Manager, Educator

●

Extremely large systems to extremely small ones

●

Vendor and a customer

My Goals: ●

●

Teach a bit of history Show a relationship to what we have today Bring what may be in the back of your mind up to the frontal lobe

Source Code Distribution Is Not New 1943-1977 computers were:

●

–

physically huge

–

logically small

–

very expensive

–

relatively few

–

Lock in? WTF?

Most application software was distributed in source code “Shrink wrap” software did not exist

“Free Software” Did Exist: 1969 (We just called it “software”)

DECUS (among others) ●

●

Customers wrote and contributed software –

“Maybe someone else will be able to use it”

–

“Maybe someone else will help to improve it”

Library stored and distributed software for small fee –

Paper catalogues

–

Paper tape

1 TByte of paper tape = 5 million kg, 2.5 million km

Unix: An Operating System (1969) “For Fun” ●

●

Portable across hardware architectures – why? Preserves: –

Human resources and training

–

Software interfaces (APIs)

–

154 system calls

“Escapes” to universities –

Carnegie Mellon

–

University of New South Wales

–

University of California, Berkeley

USENIX formed “The Unix Epoch” (Unix time) started 1/1/1970 ●

Early “Unix Stuff” ●

Doug McIlroy - 1964 –

“Pipes and Filters”

–

“Macros”

●

“I know what that problem is....”

●

Early Trojans

One More Item In 1969 X

Linus Torvalds was born.

Linus Torvalds was born just 72 hours before the Unix Epoch on January 1st, 1970. When the machines take over, they will call him Jesus - Tweeted by Dataspora on October 27th, 2010

Unix Spread More ●

Various Universities

●

Unix was not free (either in freedom or beer) –

Source code license (160000 USD per CPU)

–

University Source code license (350 USD/campus) ●

Selected universities

●

Trade secrets

Contamination issues BSD license allowed binary-only distributions –

–

● ●

Unix fragmented

USENIX hisses

The Beginning of the End 19771983 ●

●

Economies of scale made “shrink wrap” software possible Companies Started up –

100 engineers

–

1000 customers

–

2000 reports

–

20/engineer

No problem!

Time Goes On 150 engineers, 4.5 million customers ●

9 million pieces of paper

●

60000/engineer

See the problem?

Freedom of Software Is Not New 1984 – GNU ●

1984 – GNU –

●

Richard Stallman resisted “binary only”

1980s and 1990s –

Sendmail, BIND, Postgres (nee Ingres)

–

*BSDs occurred

–

1986 Project Athena (X11, Kerberos)

1991 – All But the Kernel ●

●

Linus was a student at the University of Helsinki 1991 - New chip, old operating system, new desktop, old methods... –

●

August 26, 1991 – announcement

●

September, 1991 – release of code

1993-1994 – Distributions began to appear –

●

Linux Kernel was started

SLS, Yggdrasil, Trans-Ameritech, Slackware

1994 – V1.0 of the kernel

The Alpha Port ●

●

May 1994: Met Linus (at DECUS, New Orleans) Convinced him to do 64-bit port on Alpha (a RISC processor) June 1994: Hardware in place –

Documentation gathered

–

Organization studied

January 1995: Project started November 1995: Red Hat shipped Linux – 64 bit in 1995 The power of community

Shared Libraries ●

Value to operating system

●

Ultrix – seven engineers, seven years

Beowulfs: 19941995 ●

Supercomputers were dying (ECL, Cray) –

Expensive to design and program

●

NASA: Dr. Thomas Sterling and Donald Becker

●

Supercomputers at 1/40th of the cost –

Common Off The Shelf (COTS) systems

–

High speed networking

–

●

10, 100, 1000, 10000 Mbit ETHERNET

●

Myranet

●

Crossbar switching

Solved huge numbers of problems

What Types of Problems? ●

Image rendering

●

Data Mining

●

Image recognition

●

Genome research (MySQL)

●

Weather forecasting

●

Global warming

●

Modeling and meteors Resource prospecting through seismic imaging

●

Searching document image databases Molecular dynamics simulations Virtual Reality Calculating Financial Reserves (12 hrs to 15 min)

ImageÂ Rendering

The Perfect ISP machine ●

Unix-like –

–

Multi ●

User

●

Tasking

●

Architecture

●

Network stacks

Demand paged virtual memory ●

32 bit and 64 bit

●

Stable

●

Secure

The Perfect ISP Machine (Cont.) ●

●

Had all the features –

FTP

–

Apache

–

Shell accounts

–

News

–

Etc.

Ran on “cheap PCs”

And You Had the Source Code ●

Ping problems and buffer overflows

●

1997: InfoWeek magazine: “Best Service” Award

More Free Software Timeline ●

USELINUX - “Just like it was 20 years ago” –

“SMP is hard”

●

More ports followed (SPARC, Motorola, etc)

●

September 1998 – Databases port

●

October 1998 – Companies start to support –

IBM - “We invested 1B dollars” - Why?

–

“Gerstner: In the past....”

●

High-availability software starts to appear

●

2000 – Embedded systems discover Linux

Embedded Systems Need: ●

Modular system

●

Multi-architecture

●

Network stacks

●

Device Drivers

●

Low (or no) royalties

●

Real Time

OS/2 and ATMs

More Free Software Timeline ●

●

March 2000 - .coms fail, recession strikes –

People start spending money more wisely

–

People pick Linux as solution

Winter 2003 – Red Hat becomes profitable

Software Livre! Vs Software Gratis! ●

●

Freedom in software –

Freedom to read the sources

–

Freedom to change the sources

–

Freedom to redistribute those changes

–

Freedom to use the software for any purpose

A lot of software is gratis..... –

Allows you to take money you are paying to licenses..

–

Allows you to redistribute that money to tailoring and integration

In the end, nothing is completely free of cost.

Free Software In Government ●

●

Military –

Would you trust your weapons.....

–

One of first uses for Linux was War Game Simulations

Government –

●

Would you trust your email system....

Not just war –

Companies bankrupt

–

Companies drop support

Barriers to Entry In the past hardware was expensive....how expensive is it now... ●

●

...to hire someone who speaks English? ...to purchase one “seat” for a design engineer 10 seats?

....or

...to buy all the software you need to start your business? ...to negotiate all the software contracts you need?

“We are waiting for the letter of authorization...”

A Balance of Payments Software Freedom means... ●

●

Less money leaves your area for packaged software More money can be spent locally on tailoring Open Source, which.. –

Creates local jobs ●

Who eat local food, buy local housing, pay local taxes –

Which creates more local businesses ● ●

Who need more tailoring of software Which creates more local jobs...

4000 Business People In A Room... ●

●

How many have had a bug in proprietary software? How much did that cost? –

Lost time

–

Lost effort

How many have had to change the way they did business? How much did that cost? –

Retraining

–

Loss of sales

–

Customer dissatisfaction Software Freedom allows Business Decisions

Today – 1.25Billion+ 1,250,000,000 General Purpose Computers: ●

1,000,000,000 Micro$oft

●

125,000,000 Linux – based

●

125,000,000 “everything else”

What happens to the other 5,500,000,000?

Today ●

●

Linux shipping on 1/2 of all new server systems –

MVS, Solaris, AIX, HP/UX

–

Windows Server

Linux used on most new supercomputers –

95% Linux

–

1% Windows

–

4% “Other” (Solaris, AIX, etc)

Linux is most-used OS in new design starts for embedded systems Linux is now out-selling Apple on desktop, netbooks and in phones (Android)

Sourceforge.net â&#x2014;?

230K+ projects

â&#x2014;?

2M+ developers

But What About....? ●

●

Standards – Free Standards Group (www.freestandards.org) Certification – Linux Professional Institute (www.lpi.org) Support –

Most major system vendors

–

Distributors, VARS

–

Local support

Emerging Areas ●

Creative Commons –

●

Open Hardware –

●

Openness in artistic creativity Collaborative design (Arduino)

Open Multimedia –

Blender Association

–

Open Journalism (Sourcefabric.org)

Open Business –

Coopetition The next Albert Einstein of Computer Science...

Emerging Areas ●

Creative Commons –

●

Open Hardware –

●

Openness in artistic creativity Collaborative design (Arduino)

Open Multimedia –

Blender Association

–

Open Journalism (Sourcefabric.org)

Open Business –

Coopetition The next Albert Einstein of ___________________...

Does Closed Source Allow You To Do This? ●

●

A 15 year old kernel developer A 14 year old distribution developer An 11 year old programmer of supercomputers Entrepreneur - 19

Future Issues The Issues are not technical ●

●

Software contamination –

Trade Secrets

–

Copyrights

–

Patents

Adoption by world economies

I Would Like to Thank ●

LinuxProMagazine for sponsoring me

●

POSSCON for inviting me

●

You, for listening

●

...but most of all... the Free Software community...

I Would Like to Thank the Free Software Community on behalf of: ●

●

The Royal Navy Air and Rescue Force (allows faster rescues) The Genome project (allows easier sharing of data) The Borehole Project in Africa (allows clean water for 7000 additional families) Faster Detection of Cancer (24 hours to 10 minutes) For the hundreds of students at the University of the South Pacific in Fiji (to study and learn) 1600 doctors in Cuba who use it (to spread information) Scientists at Fermilab looking for the smallest bit

Reach Out And Join....

If you want to see the most important person in Free Software, look in the mirror!

Questions?

FOSS Teaches You Twice Or Three Times

by Jon "maddog" Hall Executive Director Linux International速

Trademarks â&#x2014;?

â&#x2014;?

Linux is a registered trademark of Linus Torvalds in several countries Unix is a trademark of X/Open in several countries

This Is Me ....and Why You Should Listen. ●

●

Forty-two years in the computer industry –

Mainframes 5 years

–

Unix 20 years

–

Linux since 1994

Programmer, Systems Administrator, Systems Engineer, Product Manager, Technical Marketing Manager, College Educator

●

Extremely large systems to extremely small ones

●

Vendor and a customer

What Are Goals of Education? ●

Baby-sit kids?

●

Train for jobs?

What Are Goals of Education? ●

●

Create a: –

Thinking Electorate

–

Thinking Workforce

–

Lifetime knowledge

Research –

Public Research with Public money

–

Private Research with Private money ●

But how much is “private”?

At One Time Even I Was Young: DECUS - 1969 ●

A Text Editor or....

●

Why did they do this?

●

Amateurs vs Professionals –

Amateur painters

–

Amateur athletes

Also In 1969 ●

Unix was started

●

A baby was born

Importance To Students ●

Proprietary Products: Apollo, Nortel

●

Hard to create interesting software

●

–

As a single contributor

–

As a non-leader

“Portfolio” of useful work by graduation –

Not “Throw-away” projects

–

Most beginning programmers will work on “apache”

–

Most new graduates will be on a team

Importance To Country ●

Local jobs –

High Tech

●

Balance of Trade

●

Eliminate piracy

●

Security of country

●

–

Economic

–

Military

–

Longevity

Leadership

John Lions University of New South Wales ●

●

Best way of training students was to show them good code Version 6 Unix –

Commented kernel

–

Annotated kernel

–

Tried to publish

AT&T blocked

A Complete Computer Science Curriculum ●

Operating Systems Design –

Kernels ●

Linux

●

*BSD

●

FreeDOS

●

TinyOS

●

CMU MACH

●

Hurd

A Complete Computer Science Curriculum (Cont.) ●

Operating Systems Design (Cont.) –

–

Multi ●

user

●

tasking

●

threaded

●

architecture

memory managed and not ●

32 and 64 bit

Operating System Design (Cont.) ●

●

Filesystems –

FAT (FAT-16, FAT-32, VFAT, etc.)

–

NTSC

–

Unix

–

Log-based

–

Journaled

Networked file systems –

NFS, SAMBA

Operating System Design (Cont.) ●

Networking –

TCP/IP

–

X.25

–

Appletalk

–

SMB

–

DECNET

–

802.11x

–

Bluetooth

Operating System Design (Cont.) ●

●

Security aspects –

Kerberos

–

SELinux

Graphics –

X Window System

–

OpenGL

Clustered systems (HPC and HA)

FOSS Not Just “An Operating System” ●

Compilers –

●

“C”, C++, Fortran, Pascal, Lisp, BASIC, etc.

Interpreters –

Python, Perl, Ruby, Tcl/Tk

●

Database engines

●

Office Systems

●

Multimedia tools

●

VoIP

FOSS Not Just “An Operating System”: Telephony ●

VoIP – SIP

●

Asterisk

●

Android

FOSS Not Just “An Operating System”

●

Electrical Engineering – and open tools

●

Spice

●

Circuit Simulators

●

Many electronic programs and books for free (not all FOSS, some run on Windows) –

http://tech-systems-labs.com

–

http://freebyte.com/eletronics

–

http://opencircuits.com

Arduino

FOSS Is Not Just CS: Multimedia

FOSS Is Not Just CS: Social Studies ●

Statistical packages

●

Geographical Information –

OpenGIS

–

OpenStreetmap

FOSS Is Not Just CS: Law, English, Philosophy ●

●

Intellectual Property –

Patent Reform

–

Creative Commons

Project Gutenberg –

100,000 e-books

FOSS Is Not Just CS: Business Practices ●

●

Service as a business –

Brain Surgery

–

Law

Musicians – Creative Commons –

Beatles

–

Eric Clapton

–

The Grateful Dead

Entertainers, not “money producers” Copyright Linux International 2011

FOSS Is Not Just CS: The Arts â&#x20AC;&#x201C; Creative Commons

SourceForge

230K+ projects 2.3M+ developers

Without China, India, South America, etc. being fully connected to Internet Copyright Linux International 2011

A New Old Model of Developing Software When software is free.... ●

You pay for

service

–

Service in copying and distributing

–

Service in getting features in your time frame

–

Service in integrating

–

Service in training

●

Worst Case: You pay for the software one time

●

Best Case: You never pay for the software again

Things to Teach In New Model

●

How to do distributed development

●

How to license software

●

How to develop formal standards

●

How to write code to standards

●

How to motivate software developers

●

How to locate and engage the community of users and developers How to innovate, everywhere, always How to evaluate and size customer needs

More Things To Teach (and not teach) ●

Teach: –

Fundamentals ●

How does computer really work? – –

●

–

●

How do compilers, OS really work?

Comparison evaluation ●

–

Machine language Cache

Various office packages

How to share

Do not teach: –

Specific products (Nortel?)

More Than Just Software ●

Free Standards Group –

●

Linux Professional Institute –

●

www.lpi.org

Linux Training –

●

www.freestandards.org

www.lintraining.com

Open Hardware –

SolarPC (www.solarpc.com)

–

Open Telephony

Supercomputers..... ●

1994 – a problem

●

Beowulf Systems

●

–

GNU/Linux

–

PVM, MPI, OpenMP

Numa machines –

The same APIs

“The power of an IBM SP/2 for 1/40th of the price.” - Pat Goda, Los Alamos Labs Copyright Linux International 2011

...to Workstation Farms.... ●

●

Lots of COTS Tied together with high-speed networking

....to Embedded Systems.... ●

Modular kernel

●

Multi

●

–

Architecture

–

User

–

Tasking

–

Secure

–

Stable

Royalty Free

LTSP Linux Terminal Server Project ●

●

Server system –

Data in one place

–

Programs in one place

Thin clients –

Display data

–

Act as local transport ●

USB

●

Sound

●

Video

Curitiba, Brazil ●

High School that had everything

●

High School that had “nothing”... –

Except pride

Some Great Projects ●

www.mythtv

●

www.linuxmce.org

●

http://misterhouse.sourceforge.net

●

www.asterisknow.org

●

www.trixbox.org

●

www.openoffice.org

A Challenge for This Region ●

●

Find your brightest students Get them to create a proposal for an embedded system products Choose best five proposals Get CS students to develop software on GNU/Linux systems Get EE students to develop controllers Get companies to manufacture products, create jobs

Well-Meant Misconceptions ●

“We want to train our students in the software they will be using in their jobs.” –

●

most server systems are Linux, Unix or Proprietary systems

“We want our students to use specific software so they can get jobs when they graduate” –

Are they smart or are they stupid?

Well-Meant Misconceptions (Cont.) ●

“We want to use widely-used software in our research so our research can be used right away by millions of people.” –

●

64 bit and clusters

“Everybody uses XXXXXXX” –

Collaboration is easier Except you can not change software ● You can not collaborate with everyone ●

Well-Meant Misconceptions (Cont.) ●

●

“We will give you software, gratis!” –

This year

–

Gratis software is not necessarily free!

–

Gratis software is not necessarily gratis!

We have “shared source” –

40 countries

–

500 companies

–

1000 “top research” universities

Other Resources ●

Moodle

●

K12LTSP

●

Free Technology Academy

●

MIT Open Courseware –

Other universities too

Would Closed Source Allow Them To Do This? ●

Enterprise Creator – 22

●

President - 21

●

Kernel Developer – 15

●

Distribution Developer - 14

●

Soweto Entrepreneur - 22

Thank You ●

POSSCON

●

Red Hat

●

Linux Foundation

●

Linux Pro Magazine

●

Free Software Developers everywhere

Questions?

Hidden Costs Of Proprietary Software

by Jon "maddog" Hall Executive Director Linux速 International速

Trademarks â&#x2014;?

â&#x2014;?

Linux is a registered trademark of Linus Torvalds in several countries Unix is a trademark of X/Open in several countries

Software Li[bv]re! ●

Free as in freedom, not free as in beer. –

Free to read the source code

–

Free to make changes to the source code

–

Free to redistribute those changes

–

Free to use the software for any purpose

–

You can not limit another's freedoms

Richard Stallman has never said you should not make money writing software.

Once “All” Software was “Free and Open Source” ●

●

Software written to specification –

Inputs, outputs and steps to be taken were specified

–

contract was written

Criteria for acceptance –

Bug rate

–

Documentation

–

On time

–

Other...

Software Owned By Customer If changes needed, could (re-)select vendor ●

Bugs fixed

●

Extensions

Some Software Was Even “Free” DECUS - 1969 ●

A Text Editor or....

●

Why did they do this?

●

Amateurs vs Professionals –

Amateur painters

–

Amateur athletes

Some Problems Did Exist ●

●

Too expensive to give an “amateur” a computer Communication was by snail mail and uucp –

“You are going to email me HOW MUCH?”

The Death of Middle Earth 1980-1983 ●

●

Commercialization of Unix –

Sun Microsystems – 1981

–

USENIX hissed

PC happens –

Low price hardware and software

–

Microsoft, Apple and others (CP/M)

–

Growth of the Computer Store

RMS Objects ●

Richard Stallman forms GNU project

●

Later forms Free Software Foundation

The Problems With Mass Production In the beginning.... ●

100 engineers

●

1000 customers

●

2 reports/customer/year

●

2000 reports/year

●

20 reports/engineer No problem!

Now It Is 2011... The company has grown ●

200 engineers

●

4.5 million customers

●

2 reports/customer/year... Do you see the problem?

Now It Is 2011... The company has grown ●

200 engineers

●

4.5 million customers

●

2 reports/customer/year... Do you see the problem?

Sometimes I Speak To Hundreds Of Business people.... ●

Who has ever had a problem with closed source programs?

●

Who has turned in a problem report?

●

Who has gotten a good answer back?

●

Who has had to change their business?

Software As A Service (SaaS) “clouds” only make this problem worse”

Today There Are 1,250,000,000 General Purpose Computers

But there are 6.3 Billion people

Proprietary companies can not meet the needs of everyone Nor will they even try....it is not profitable!

What If We Lose Only 15 Minutes A Day? ●

●

Worldwide daily loss –

$5 for 15 minutes

–

Times 1.25 Billion desktop computers

–

6.25 billion dollars a day

300 “Knowledge Workers” –

Nine people never came to work “IT is not in our best business interest!”

Rio de Janeiro ●

Small company investigating rain forest –

●

Needed GIS software ●

Very expensive

●

Only in English

Can this part be done in Open Source? –

OpenGIS, GNUplot, PostgreSQL, Python

Binary-Only Software What Else Is Wrong? ●

Can not see how software works

●

Can not learn from existing software

●

Hard to do research

●

–

Hard to exchange research efforts

–

Hard (or impossible) to get research out to consumers

Companies go out of business –

Companies drop product lines

Software for the 21 Century The planets aligned.... ●

Hardware prices for significant systems dropped

●

Large number of books, articles on software

●

The Internet happened

●

Massive amounts of free code were available

●

–

GNU software

–

Xfree86

–

Sendmail

Linus Torvalds turned 21

What Are Goals of Education? ●

●

Create a: –

Thinking Electorate

–

Thinking Workforce

–

Lifetime knowledge

Research –

Public Research with Public money

–

Private Research with Private money ●

But how much is “private”?

Importance To Country ●

Local jobs –

High Tech

●

Balance of Trade

●

Eliminate piracy

●

Security of country –

Economic

–

Military

–

Longevity – Nortel?

Total Cost Of Ownership ●

New Hardware

●

New Software

●

Integration

●

Education

●

Ongoing support

“Enlightened TCO” ●

●

Cost of upgrading software and hardware Cost of tracking licenses Retirement costs of hardware and software –

Can you re-use or sell either hardware or software?

●

Backup and exchange of data

●

Use of software for any purpose

●

Choice and competition

Value of Software ●

●

Does solution meet your needs? –

Do you have to change the way you do business to meet the needs of the software?

–

Does the solution either save you money or allow you to serve your customers better?

Can you sell the solution? A tale of two CDs