Salmon Run

Swimming upstream on the technology tide, one technology at a time. A collection of articles, tips, and random musings on application development and system design.

Showing posts with label spark. Show all posts
Showing posts with label spark. Show all posts
Saturday, October 07, 2023

A PySpark idiom for efficient Model Inference

›
I recently needed to build an Apache Spark (PySpark) job where the task was (among other things) to use a Language Model (LM) to encode text...
Friday, August 31, 2018

Collaborative Filtering Recommender with Spark GraphX

›
Earlier this week, I attended a webinar titled Building the Next Generation Recommendation Engine with a Graph Database hosted by TigerGra...
Saturday, March 17, 2018

Accessing ML models in Spark from various NLP toolkits

›
NLTK users know that a lot of functionality, even seemingly basic ones like sentence and word tokenization, are dependent on machine learn...
4 comments:
›
Home
View web version

About me

My photo
Sujit Pal
I am a programmer interested in Semantic Search, Ontology, Natural Language Processing and Machine Learning. My programming languages of choice are Java, Scala, and Python. I love solving problems and exploring different possibilities with open source tools and frameworks.
View my complete profile
Powered by Blogger.