• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 

2

Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'

3

Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics

1

Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 

2

Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'

3

Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics
TechBig Data

IBM blesses Spark in its latest big data push

Barb Darrow
By
Barb Darrow
Barb Darrow
Down Arrow Button Icon
Barb Darrow
By
Barb Darrow
Barb Darrow
Down Arrow Button Icon
June 15, 2015, 8:00 AM ET
Inside IBM Research Headquarters
The International Business Machines Corp. (IBM) signage is displayed in front of the Thomas J. Watson Research Center, the headquarters of the company's research, in Yorktown Heights, New York, U.S., on Tuesday, Feb. 11, 2014. IBM is spending $1 billion to build a new division around its Watson supercomputer, which can analyze large volumes of data and answer questions. Photographer: Scott Eells/Bloomberg via Getty ImagesPhotograph by Scott Eells — Bloomberg/Getty Images

IBM is a big proponent of big data and the successful application of big data techniques to help businesses run better.

Increasingly, big data jockeys are looking beyond Hadoop, the distributed file system that is the foundation of many big data applications, to Spark for analyzing that information.

By way of introduction, Sparkis an open-source project for in-memory data processing that aims to speed up the crunching of huge amounts of data, typically data held in Hadoop. Spark’s claim to fame, in fact, is that it can do that data crunching faster and easier than MapReduce, the tool typically used along with Hadoop for these applications.

So, on Monday, IBM (IBM), which always likes to wrap its stated intentions in press releases, said it is opening a Spark Technology Center in San Francisco. It also vowed to incorporate Spark in all of its analytics and e-commerce products and to dedicate 3,500 developers to Spark-related work, although it’s unclear where all those developers will come from. Spark itself will be also offered as a service on IBM’s Bluemix development platform.

News of the effort leaked last week but now it’s official.

IBM’s endorsement of open-source projects like Spark has proven fruitful in the past. IBM was an early booster of the Linux operating system and Eclipse Java tool set, for example.

The Spark project isn’t just about fast, in-memory processing. The overall Spark umbrella also includes a file system, machine learning, stream processing components.

IBM moves comes as it tries to bolster revenue from data analytics projects, and recruit more developers to use its tools—including Bluemix—to develop next-generation applications. In this arena it faces a raft of newer companies like Cloudera and Hortonworks (HDP), that have already endorsed Spark and don’t have to support the legacy businesses that IBM has to keep running.

Subscribe to Data Sheet, Fortune’s daily newsletter on the business of technology.

About the Author
Barb Darrow
By Barb Darrow
See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Elon Musk sits with his fists together, looking up.
NewslettersTerm Sheet
SpaceX’s IPO filing is full of surprises
By Allie GarfinkleMay 21, 2026
3 minutes ago
SpaceX CEO Elon Musk unveiling the company's new manned spacecraft in Hawthorne, Calif. on May 29, 2014. (Photo: Kevork Djansezian/Getty Images)
NewslettersFortune Tech
Rollout complete: SpaceX files IPO prospectus
By Andrew NuscaMay 21, 2026
48 minutes ago
microsoft
AIProductivity
America’s new AI map shows something surprising: ‘A lot of normal people are adopting AI’
By Nick LichtenbergMay 21, 2026
2 hours ago
Sheryl Sandberg tells Gen Z the 10-year career plan is dead as AI wipes out entry-level jobs: ‘Don’t script your career when the future is uncertain’
Successcareer
Sheryl Sandberg tells Gen Z the 10-year career plan is dead as AI wipes out entry-level jobs: ‘Don’t script your career when the future is uncertain’
By Orianna Rosa RoyleMay 21, 2026
4 hours ago
Microsoft lost its way in the AI race. Can Copilot get it back on course?
MagazineMicrosoft
Microsoft lost its way in the AI race. Can Copilot get it back on course?
By Jeremy KahnMay 21, 2026
4 hours ago
Samuel Corum/Getty Images
Big TechSpaceX
Elon Musk’s proposed pay package in SpaceX’s IPO filing reveals what the company actually is: a $1 trillion monster built to colonize Mars
By Eva RoytburgMay 20, 2026
11 hours ago

Most Popular

Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 
Workplace Culture
Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 
By Preston ForeMay 19, 2026
2 days ago
Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'
Success
Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'
By Preston ForeMay 20, 2026
20 hours ago
Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics
Future of Work
Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics
By Mike Householder and The Associated PressMay 17, 2026
4 days ago
The Bezos family just donated $100 million to help achieve one of Mayor Zohran Mamdani’s top campaign promises
Politics
The Bezos family just donated $100 million to help achieve one of Mayor Zohran Mamdani’s top campaign promises
By Jake AngeloMay 12, 2026
9 days ago
Dr. Bernice King on why companies that walked back DEI were never truly committed: 'If you retreat that quick…that reveals who you really are'
Workplace Culture
Dr. Bernice King on why companies that walked back DEI were never truly committed: 'If you retreat that quick…that reveals who you really are'
By Preston ForeMay 19, 2026
2 days ago
Current price of oil as of May 20, 2026
Personal Finance
Current price of oil as of May 20, 2026
By Joseph HostetlerMay 20, 2026
21 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.