Matt's Tech Blog
open-menu closeme
Blog
About
English Deutsch
github linkedin
  • Reading all of Wikipedia in 6 seconds: how to utilize multiple cores to process very large text files

    calendar Oct 16, 2020 · 51 min read · NATURAL LANGUAGE PROCESSING NLP MULTIPROCESSING C PYTHON  ·
    Share on: twitter facebook linkedin copy

    I was about to do some basic natural language processing (NLP) task on a large text file: create a dictionary of unique words and count how many times each word occurs. Easy peasy. This should only take me a minute. So I thought. While coding did not take more than 2 zips of coffee, I needed to wait almost an hour for …


    Read More
  • How to simultaneously write to shared memory with multiple processes

    calendar Oct 5, 2020 · 20 min read · MULTIPROCESSING C  ·
    Share on: twitter facebook linkedin copy

    Most of our modern day computers have more than one processing unit. They are often referred to as cores. For a developer, effectively using multiple cores simultaneously to speed up program execution by parallel processing comes with challenges. One of them is changing the value of a variable in shared memory. In this …


    Read More

Matt Lind

Tech geek, command-line aficionado, AI enthusiast, life-long learner.
Read More

Featured Posts

  • How to setup your own ChatGPT and connect it to your own data

Recent Posts

  • Reading all of Wikipedia in 6 seconds: how to utilize multiple cores to process very large text files
  • How to simultaneously write to shared memory with multiple processes
  • Migrating my GitHub pages blog from Jekyl to Hugo
  • Using logistic regression to classify images
  • Understanding linear regression
  • Deep Neural Network for MNIST Handwriting Recognition
  • Simple 3-Layer Neural Network for MNIST Handwriting Recognition

Tags

MACHINE-LEARNING 6 COMPUTER-VISION 4 BLOGGING 2 C 2 MATH 2 MULTIPROCESSING 2 NATURAL-LANGUAGE-PROCESSING 2 NLP 2 PYTHON 2 CHAT-GPT 1
Matt's Tech Blog

Copyright 2015-  MATT'S TECH BLOG. All Rights Reserved

to-top