PictoBlox Extensions
  1. Scratch Based Default Extensions
    1. Motion
    2. Looks
    3. Sound
    4. Control
    5. Events
    6. Sensing
    7. Operators
    8. My Blocks
    9. Variables
  2. Artificial Intelligence
    1. Face Detection
    2. Object Detection
    3. Human Body Detection
    4. Computer Vision
    5. Text Recognition
    6. Speech Recognition
    7. ChatGPT
    8. Natural Language Processing
    9. Recognition Cards
    10. Text to Speech
    11. Translate
  3. Innovative Extensions
    1. QR Code Scanner
    2. Weather Data
    3. Physics Engine
    4. IFTTT Webhooks
    5. Internet of Things (IoT)
    6. Data Logger
    7. Music
    8. Video Sensing
    9. Pen
  4. Machine Learning Environment
    1. Image Classifier (ML)
    2. Object Detection (ML)
    3. Pose Classifier (ML)
    4. Hand Pose Classifier (ML)
    5. Audio Classifier (ML)
    6. Number Classifier and Regression (ML)
    7. Text Classifier (ML)
  5. Quarky
    1. Quarky (Main)
    2. Display (Quarky)
    3. Robot (Quarky)
    4. Sensors (Quarky)
    5. Speaker (Quarky)
    6. Quarky Ultimate Robots
    7. Quarky Expansion Board
    8. Mars Rover
    9. Quadruped (Quarky)
    10. IoT House (Quarky)
    11. Quarky Mecanum
    12. Dabble
PictoBlox Extension

Speech Recognition

Speech Recognition
Extension Description
AI to recognize text from speech.
  • STEMpedia-Rocket-800x800 Available in: Block Coding, Python Coding
  • STEMpedia-Rocket-800x800 Mode: Stage Mode
  • STEMpedia-Rocket-800x800 WiFi Required: Yes
  • STEMpedia-Rocket-800x800 Compatible Hardware in Block Coding: evive, Quarky, Arduino Uno, Arduino Mega, Arduino Nano, ESP32, T-Watch, Boffin, micro:bit, TECbits, LEGO EV3, LEGO Boost, LEGO WeDo 2.0, Go DFA, None
  • STEMpedia-Rocket-800x800 Compatible Hardware in Python: Quarky, None
  • STEMpedia-Rocket-800x800 Object Declaration in Python: sr = SpeechRecognition()
  • STEMpedia-Rocket-800x800 Extension Catergory:

Introduction

Speech Recognition

Speech recognition is the ability of a machine to identify words and phrases in spoken language and convert them to a machine-readable format.

How Speech Recognition Works

Speech recognition is very complex, and many mathematical equations are involved. Let’s break it down into simple steps:

  1. First, the machine records the audio file.
  2. Then, it breaks down the audio to extract consonants and vowels (the building blocks of a text). After this process, we get a list of consonants and vowels.
  3. Using the word database of the language, the machine tries to identify words from the list and then make sentences, thus converting the speech into text.

Accessing Speech Recognition in Block Coding

Following is the process to add Speech Recognition capability to the PictoBlox Project.

  1. Open PictoBlox and create a new file.
  2. Select the coding environment as Block Coding.
  3. Next, click on the Add Extension button and add the Speech Recognition extension.
  4. You can find the Speech Recognition blocks available in the project.

Accessing Speech Recognition in Python Coding

Following is the process to add Speech Recognition capability to the PictoBlox Project.

  1. Open PictoBlox and create a new file.
  2. Select the coding environment as Python Coding.
  3. Next, click on the Add Modules/Libraries button and add the Speech Recognition extension.
  4. To access the library functions, you have to add the object declaration. 
    sr = SpeechRecognition()
Read More

PictoBlox Blocks

The block sets a loudness filter threshold to remove the background noise from the audio file which is being analyzed.
When the block is executed, the recognition window will open and you will get a specified time during which PictoBlox will record whatever you say. Once recorded, the speech will be converted to the text of the language you spoke in and saved locally.
The function reports the last text detected from the speech.
All articles loaded
No more articles to load

Block Coding Examples

Speech Recognition

Home Automation – Light Control

The example demonstrates how to make smart home automation for light control using NLP and Speech Recognition.

Speech Recognized Control of Mars Rover

Learn how to code logic for speech recognized control of Mars Rover with this example block code. You will be able to direct your own Mars Rover easily by just speaking commands.

Speech Recognized Controlled Mecanum

Learn how to code logic for speech recognized control of Mecanum with this example block code. You will be able to direct your own Mecanum easily by just speaking commands.

Synonym and Antonym Conveter

Discover a unique experience in a Synonym/antonyms World, where the combined powers of Speech Recognition and ChatGPT Extension.

Voice Controlled Smart Plug

This project demonstrates how to create a voice-controlled smart plug using natural language processing (NLP), speech recognition, and a relay.
All articles loaded
No more articles to load

Python Functions

setthreshold()
The function sets a loudness filter threshold to remove the background noise from the audio file which is being analyzed.
Syntax: setthreshold(loudness = 30)
analysespeech()
When the function is executed, the recognition window will open and you will get a specified time during which PictoBlox will record whatever you say. Once recorded, the speech will be converted to the text of the language you spoke in and saved locally.
Syntax: analysespeech(time = 2, language = “en-US”)
speechresult()
The function reports the last text detected from the speech.
Syntax: speechresult()
All articles loaded
No more articles to load

Python Coding Examples

Python Based Speech Recognition Controlled Mecanum

Learn how to code logic for speech recognized control of Mecanum with this example block code. You will be able to direct your own Mecanum easily by just speaking commands.

Python Based Speech Recognized Control of Mars Rover

Learn how to code logic for speech recognized control of Mars Rover with this example block code. You will be able to direct your own Mars Rover easily by just speaking commands.
All articles loaded
No more articles to load
Table of Contents