With a long-term commitment to technology innovations involving the Spark platform, Huawei has contributed significantly to the development of the Spark core, SparkSQL, distributing key machine learning algorithms. Jia Yongli, Big Data Technology Leader, Huawei, said, "Huawei's strategic big data positioning and proactive participation in the Spark community has played an important role in building and expanding the presence of the Spark platform. Our continued involvement will remain critical as we seek to keep abreast of cutting-edge technologies and enable our customers to access Spark applications towards the goal of establishing an open, cooperative, and win-win big data ecosystem.”
In the big data field, the Apache Spark community has become the most influential and active open source community with more than 50 institutions participating and making code contributions. With the significant number of contributors and the number of new codes generated, which far surpasses other similar open source projects, Spark has become a new-generation mainstream standard for big data computing architecture. Databricks, a company founded by the creators of Shark, has developed the “Certified Spark Distribution” program to highlight and recognize third party vendors distributing Spark.
Andy Konwinski, Founder of Databricks, said, “Huawei’s contributions to the Spark program and community highlights its long-term commitment to Spark. We expect Huawei to bring more users and use cases to the community and drive further adoption of Spark in vertical markets.”
