AI & Data Science
Victor Figueroa
Prestrud
Building intelligent systems - from reinforcement learning to production web apps.
View My Work
About Me
Victor Figueroa
Prestrud
3+
Years Experience
5+
Projects Built
AI
Specialisation
What I've Built
Projects

01
Kravbank: AI for Public Procurement (Bachelor Thesis)

02
Deep Learning for Image Classification (PGR207)

03
Predictive Analytics: Time Series Forecasting (PGR304)
04
Advanced AI Architectures (RL & PSO)

Warehouse Robot (RL)
Q-Learning agent navigating a stochastic environment with a 67% success rate.

Particle Swarm Optimization
Evolutionary algorithm optimizing complex multimodal functions like Rastrigin.
Live Demo
Q-Learning Agent
An interactive demo of Q-Learning. The same algorithm at the core of my RL & PSO project, rebuilt in TypeScript to run live in the browser. Tune α, γ, and ε and watch the dog learn to find the treat.
Episode
0
Successes
0
Success Rate
0%
Hyperparameters
How quickly the agent updates its Q-values
How much future rewards are valued vs immediate
Probability of taking a random action (explore vs exploit)
How it works
The dog 🐕 starts at S and must reach the treat 🦴 while avoiding humans 🧑 and walls. Each step it chooses to explore (random action) or exploit (best known action) based on ε.
After each step the Q-value is updated via: Q(s,a) ← Q(s,a) + α·[r + γ·max Q(s') − Q(s,a)]
Toggle Q-Values to see the learned policy. Arrows show the best action per cell, brightness shows how valuable each state is.
What I Work With
Skills
01
Data Science
- Python
- Machine Learning
- Data Analysis
- SQL & Databases
02
Artificial Intelligence
- Deep Learning
- Neural Networks
- Computer Vision
03
Natural Language Processing
- Text Classification
- Sentiment Analysis
- Speech Recognition
04
Web Development
- React & Next.js
- Node.js & Express
- API Development
Experience & Education
Resume
AI Assistant
Ask About My Resume
Let's Talk
Get In Touch
Have a project in mind or want to collaborate? Pick the channel that works best for you.
vctrfgr1@gmail.com
Phone
+47 462 96483
victorfigueroa001
GitHub
QuasimodoCodes
Or send a message directly