Monthly Archives: October 2018

Highlights from Spark + AI Summit 2018 (SAIS 2018)

Are you into cluster-computing with Apache Spark? This year’s SAIS 2018 conference covered great data engineering and data science best practices for productionizing AI. In a nutshell, you should keep your training data fresh with stream processing, monitor quality, test and serve models (at massive scale when talking about Spark). The conference also provided some deep dive sessions on Spark integration with popular machine learning frameworks, such as well known TensorFlow, Scikit-learn, Keras, PyTorch, DeppLearning4j, BigDL and Deep Learning Pipelines.

Here is the list of several interesting topics (in case you couldn’t join;-):

Spark Experience and Use Cases

CERN’s Next Generation Data Analysis Platform with Apache Spark

Great talk about Spark utilization for HEP (high energy psysics) data processing and analysis as a complementary tool for current rid computing in CERN.

Continue reading

Advertisements

Highlights from IEEE International Conference on Image Processing 2018

“Imaging beyond imagination”

That is this year’s ICIP 2018 conference theme. I attended the world’s largest and most comprehensive technical conference focused on image and video processing and computer vision.

Here are my special picks:

Image Representation an Modeling

Reducing Anomaly Detection in Images to Detection in Noise

Smart approach to anomaly detection by removing self-similar content of the image – ready to use for detecting material defects, tumors and others!

Continue reading