Why do we put content first
Any user - and this is a current or potential student - interacts not with bare code, neural networks and methods, but with content. And the interest in learning directly depends on the quality of this content.
Today on the blog we’ll share our thoughts on why in e-learning in general and in Puzzle English in particular, content is so important and the technologies we deliver are not so important.
Let's start with the most important thing - the user should understand both the content itself and the content distribution system on the site. This means that it is not enough to describe the task in detail or to explain in detail the rule of using articles, you also need to correctly submit all this.
Therefore, the learning process with us is based on simple principles: systematic, structured, connected. And in each of them one more is manifested - flexibility.
Systematicmanifests itself in the fact that the user follows a consistent program, competent from a methodological point of view. This can be a course dedicated to business English, or a Puzzle Academy for those who are preparing for independent travel abroad, and any courses using the Ticher method. In all cases, there will be transitions from simple to complex tasks, setting specific goals, training with an emphasis on topics that are important for a particular student. And yes, flexibility will also be in the ability to “start” from a certain level, skipping already well-studied topics. In general, the whole process is subject to a certain logic, system.
The second important principle is structuredness . This is why all content is divided into categories:
- by topic (it is obvious that all users have their own goals and interests);
- by difficulty level and level of English (from Beginner (A1-A2) to Advanced (C1-C2));
- on the linguistic aspect (we take into account the study of which language unit the content is directed to - adjectives, nouns, verb forms, idioms and so on);
- by style (determining the age and interests of the student, we can predict which style of content will interest him).
Thanks to these categories, it’s easier for us to offer students suitable programs, and it’s easier for students to find courses that are interesting to them. Such a structure is most effective: if the lessons are arranged in alphabetical or even chronological order, it is very difficult to find the right one.
Let's not hide: we have long tested different models and continue to search for the perfect solution. Previously, for example, grammar exercises were divided only by level and date of addition - it was chaos, it was very difficult to find something specific. But over time, we added a separation of topics and teachers, and for users everything became very simple and clear. In the near future we will build an even clearer “hierarchy” of grammar exercises so that all tasks go strictly from simple to complex.
Another important principle is connectivity.. A language does not exist out of context, and we strive to create it in different modules. For example, a student watches a movie clip with subtitles, hears and sees an unfamiliar word, adds it to the dictionary. But this is not enough to remember and learn it, so we offer to work it out in games or in word training. And vice versa - by studying a word in an exercise, a person can get a video with an example of use: he will listen to how live actors and TV presenters say a new word on the air, pay attention to the context and are more likely to fill up their own vocabulary.
Naturally, creating simple understandable content is not enough - the user should also be interested. Not all people who want to learn English, it is important what technology will be used in training. The main thing is that there should be an effect. And to make it fun, of course.
We will talk about the effectiveness of training in the next paragraph, and in this we will discuss the multimodality of our system. So, we have several forms of educational content submission that help us to keep the user's attention and maintain his interest.
Vocabulary. These are not only foreign words with text translations, but also transcriptions, and audio, and even videos with pronunciation examples. Moreover, the examples are very different: frames from cartoons, fragments from movies and TV shows, episodes of television shows. And men and women, British and Americans read the text at a fast and slow pace (more than 20 votes in total) - so that when listening it was clear how different the word could sound. It is very important that the word is given in context: that is how it is remembered faster, therefore we realized the idea of a video dictionary as soon as it appeared.
For examples, specially prepared recordings of live speakers and the output of five different TTS (text-to-speech system, Vocalware and others) are used. The selection is carried out taking into account the contextual meaning of a word from a common database, now there are about 430 thousand precisely marked video clips with translation.
For half-marking, the Stanford Log-linear Part-Of-Speech Tagger is used . Also, when searching for translations, the frequency of words is taken into account using the 100,000 words list Brigham Young University , with partial tagging with the CLAWS-7 tag ) and Google Translate data: they are based on the largest number of queries and therefore are the most complete.
Audio and video puzzles.To make such a format for delivering training material generally possible, we needed precise marking of very different audio and video content in time. Unfortunately, today the technology is very limited - although progress is moving by leaps and bounds, it is not very keeping pace with our desires and ideas. To provide the user with a qualitatively selected fragment of speech, accuracy is required no worse than 20 milliseconds, while the best of such systems on “live” material are mistaken on average 10-15 times. Therefore, we do all the markup manually.
Synchronous Podcasts.The user can simultaneously listen to English speech, see what is heard on the screen and read the translation of the fragment of speech that he sees in front of him. Here we just apply automatic marking, as the pronunciation is almost perfect and reference.
We use the technology of “forced alignment” according to the finished transcript using the forced aligner gentle (this is an implementation of the Viterbi algorithm based on the results of speech recognition by the Kaldi ASR system ). First, transcripts are processed using the Stanford Core NLP (automatic tokenization, sentence highlighting, part-time markup). Parallel translation is carried out using the CAT (computer-aided translation) system.
A variety of types of content performs a simple function - does not let the user get bored. In addition, many formats add an element of gamification and increase excitement during training, and some even allow you to learn unnoticed, relaxing and having fun.
Let's not forget that learning is more than just games and fun. Still, the user comes to us to learn the language.
We advocate an integrated approach, therefore, even at the start, we ask students to prioritize, and then form a suitable educational program.
One way or another, in any case, we cover all the main aspects:
- reading - we teach users to understand the text using podcasts with simultaneous translation, “double subtitles” in video puzzles;
- listening - we train the perception and understanding of oral speech, for this we use video and audio puzzles, “Master Phrases”, voiceovers of words and phrases in the dictionary, podcasts;
- the formation of the lexicon - many games (“Danetka”, “Baggage of Words”, “Word Training”) and a personal dictionary help to learn new words and use them;
- the formation of grammatical competencies - here the system of classes according to the “Ticher method”, video lessons with exercises from “Grammar”, “Vitamins” and “Buns” come to the rescue;
- Writing and translation - useful skills train a personal dictionary with contextual translations, “Translates”, “Translator” and all modules with parallel translation (synchronous podcasts, double subtitles in video and audio puzzles, line-by-line translations in songs);
- the formation of a semantic field, a linguistic picture of the world - there’s just nowhere without a “live” speech in excerpts from films, TV shows, in songs in the original language, contextual translations, Puzzle English Live (analysis of simple everyday situations, videos with native speakers) are still useful on Youtube, podcasts.
Each of our modules affects several aspects of learning at once: in the course of one lesson, the user can learn to speak English better, fill up his vocabulary, learn more about the cultural code of native speakers, and improve his speaking skills.
It may seem that this is too complicated, but in reality it is realistic - in life we do not use one skill “in a vacuum”, we combine it with other knowledge and competencies. So we can say that we comprehensively prepare students for existence in a different language environment.
Of course, in order to learn effectively, the user must always remain inspired and involved in the learning process. Therefore, the content of Puzzle English is interactive and personalized.
A significant part of the tasks contains a gamification element, and this one is also interactive. And you can go deeper into this topic: for example, automatically introduce game mechanics into educational materials. Turn on automatic training of words or expressions in podcasts, add tasks to identify missing parts of speech in reading texts, and so on. Now the educational process and games are successfully combined in courses according to the “Teacher method”.
There is a more explicit form of interaction - comments on phrases. Users can ask experts questions about the use of words, the use of grammatical constructions or translations and quickly receive answers to them. For many, this is a very convenient format for communicating with teachers: briefly and on business. In this case, of course, we strive to maintain the information content of sections and pages. So that general comments that do not carry any useful information for other users, we moderate.
And here, of course, it's time to talk more about personalization. In order for each user to feel direct contact with the service and to feel that we work with him personally, we offer a personal training plan, word training and classes according to the “Teacher method”.
A personal training plan is a central component of our entire personalization system. It connects the various modules and provides the user with a meaningful and effective version of the curriculum, taking into account goals, objectives and level of knowledge. When calculating a personal plan, we use machine learning technologies, a statistical analysis of the results of tasks and game results, as well as the history of user activity - we are not very actively considering the last point, but in the future we plan to develop in this direction and base the program, including on the history use of the service. But it is important to note: we only offer a trajectory, the student always has the opportunity to change the plan as his goals change.
Word coaching is based on forgetfulness curves or Ebbinghaus curves. In short: we take into account the proven fact - 60% of the information received, as a rule, is forgotten already in the first hour, after 10 hours of the studied everything remains somewhere around 35%, then the forgetting process slows down, and as a result, it settles in the head after 6 days approximately 20% of the initial amount of information. And these 20% are quite stable - they persist after a month. Of course, we take into account the individual characteristics of the student - the speed of progress, the volume of vocabulary and the initial level of knowledge.
Classes according to the “Teacher method” are also personalized. The user can change the trajectory of his training depending on his needs and goals. Very often in the process of learning a language, people realize that they are interested in some topic more than others. This is an excellent occasion to study it in more detail! We support such aspirations, including and excluding certain modules, courses, and exercises.
But only personalization and interactivity for motivation is not enough. In general, inspiration for new exploits is perhaps the weakest point of all e-learning services. For those who study remotely in free mode, it is not easy to get yourself involved. We solve this problem with the help of newsletters with reminders of tasks, thematic digests, messages about next tasks according to a schedule in a personal plan. There is also a bonus system of "puzzles" that complements the rating system - users earn bonus points for completing tasks of a personal plan, and then spend them in a special store. You can pay for the whole exchange rate with this domestic currency, but first you have to work hard.
Based on our experience, we confidently declare that in e-learning the quality and usefulness of content is of great importance at every stage of training. Any educational service is created for students, and they are not interested in “bare” technologies. Fascinating formats, bright packaging, intuitive interface and the feeling of personal contact, along with the excitement of entertaining mechanics, easily convey educational material to users.
Now you know why content needs to be given so much attention (and what kind of content it can be). And in the following publications we will talk more about marketing at edtech. Stay tuned!
We give readers of the blog a coupon of 500 rubles for buying a subscription, which includes 8 types of training and weekly newsletters about English grammar and vocabulary. Participate in the promotion on March 8 to get even more pleasant bonuses.
And for unlimited and eternal access to all the features of the site there is an “All Inclusive” tariff (the discount is not valid).
Today on the blog we’ll share our thoughts on why in e-learning in general and in Puzzle English in particular, content is so important and the technologies we deliver are not so important.
All clear?
Let's start with the most important thing - the user should understand both the content itself and the content distribution system on the site. This means that it is not enough to describe the task in detail or to explain in detail the rule of using articles, you also need to correctly submit all this.
Therefore, the learning process with us is based on simple principles: systematic, structured, connected. And in each of them one more is manifested - flexibility.
Systematicmanifests itself in the fact that the user follows a consistent program, competent from a methodological point of view. This can be a course dedicated to business English, or a Puzzle Academy for those who are preparing for independent travel abroad, and any courses using the Ticher method. In all cases, there will be transitions from simple to complex tasks, setting specific goals, training with an emphasis on topics that are important for a particular student. And yes, flexibility will also be in the ability to “start” from a certain level, skipping already well-studied topics. In general, the whole process is subject to a certain logic, system.
The second important principle is structuredness . This is why all content is divided into categories:
- by topic (it is obvious that all users have their own goals and interests);
- by difficulty level and level of English (from Beginner (A1-A2) to Advanced (C1-C2));
- on the linguistic aspect (we take into account the study of which language unit the content is directed to - adjectives, nouns, verb forms, idioms and so on);
- by style (determining the age and interests of the student, we can predict which style of content will interest him).
Thanks to these categories, it’s easier for us to offer students suitable programs, and it’s easier for students to find courses that are interesting to them. Such a structure is most effective: if the lessons are arranged in alphabetical or even chronological order, it is very difficult to find the right one.
Let's not hide: we have long tested different models and continue to search for the perfect solution. Previously, for example, grammar exercises were divided only by level and date of addition - it was chaos, it was very difficult to find something specific. But over time, we added a separation of topics and teachers, and for users everything became very simple and clear. In the near future we will build an even clearer “hierarchy” of grammar exercises so that all tasks go strictly from simple to complex.
Another important principle is connectivity.. A language does not exist out of context, and we strive to create it in different modules. For example, a student watches a movie clip with subtitles, hears and sees an unfamiliar word, adds it to the dictionary. But this is not enough to remember and learn it, so we offer to work it out in games or in word training. And vice versa - by studying a word in an exercise, a person can get a video with an example of use: he will listen to how live actors and TV presenters say a new word on the air, pay attention to the context and are more likely to fill up their own vocabulary.
How to warm up interest?
Naturally, creating simple understandable content is not enough - the user should also be interested. Not all people who want to learn English, it is important what technology will be used in training. The main thing is that there should be an effect. And to make it fun, of course.
We will talk about the effectiveness of training in the next paragraph, and in this we will discuss the multimodality of our system. So, we have several forms of educational content submission that help us to keep the user's attention and maintain his interest.
Vocabulary. These are not only foreign words with text translations, but also transcriptions, and audio, and even videos with pronunciation examples. Moreover, the examples are very different: frames from cartoons, fragments from movies and TV shows, episodes of television shows. And men and women, British and Americans read the text at a fast and slow pace (more than 20 votes in total) - so that when listening it was clear how different the word could sound. It is very important that the word is given in context: that is how it is remembered faster, therefore we realized the idea of a video dictionary as soon as it appeared.
For examples, specially prepared recordings of live speakers and the output of five different TTS (text-to-speech system, Vocalware and others) are used. The selection is carried out taking into account the contextual meaning of a word from a common database, now there are about 430 thousand precisely marked video clips with translation.
For half-marking, the Stanford Log-linear Part-Of-Speech Tagger is used . Also, when searching for translations, the frequency of words is taken into account using the 100,000 words list Brigham Young University , with partial tagging with the CLAWS-7 tag ) and Google Translate data: they are based on the largest number of queries and therefore are the most complete.
Audio and video puzzles.To make such a format for delivering training material generally possible, we needed precise marking of very different audio and video content in time. Unfortunately, today the technology is very limited - although progress is moving by leaps and bounds, it is not very keeping pace with our desires and ideas. To provide the user with a qualitatively selected fragment of speech, accuracy is required no worse than 20 milliseconds, while the best of such systems on “live” material are mistaken on average 10-15 times. Therefore, we do all the markup manually.
Synchronous Podcasts.The user can simultaneously listen to English speech, see what is heard on the screen and read the translation of the fragment of speech that he sees in front of him. Here we just apply automatic marking, as the pronunciation is almost perfect and reference.
We use the technology of “forced alignment” according to the finished transcript using the forced aligner gentle (this is an implementation of the Viterbi algorithm based on the results of speech recognition by the Kaldi ASR system ). First, transcripts are processed using the Stanford Core NLP (automatic tokenization, sentence highlighting, part-time markup). Parallel translation is carried out using the CAT (computer-aided translation) system.
A variety of types of content performs a simple function - does not let the user get bored. In addition, many formats add an element of gamification and increase excitement during training, and some even allow you to learn unnoticed, relaxing and having fun.
What is it about efficiency?
Let's not forget that learning is more than just games and fun. Still, the user comes to us to learn the language.
We advocate an integrated approach, therefore, even at the start, we ask students to prioritize, and then form a suitable educational program.
One way or another, in any case, we cover all the main aspects:
- reading - we teach users to understand the text using podcasts with simultaneous translation, “double subtitles” in video puzzles;
- listening - we train the perception and understanding of oral speech, for this we use video and audio puzzles, “Master Phrases”, voiceovers of words and phrases in the dictionary, podcasts;
- the formation of the lexicon - many games (“Danetka”, “Baggage of Words”, “Word Training”) and a personal dictionary help to learn new words and use them;
- the formation of grammatical competencies - here the system of classes according to the “Ticher method”, video lessons with exercises from “Grammar”, “Vitamins” and “Buns” come to the rescue;
- Writing and translation - useful skills train a personal dictionary with contextual translations, “Translates”, “Translator” and all modules with parallel translation (synchronous podcasts, double subtitles in video and audio puzzles, line-by-line translations in songs);
- the formation of a semantic field, a linguistic picture of the world - there’s just nowhere without a “live” speech in excerpts from films, TV shows, in songs in the original language, contextual translations, Puzzle English Live (analysis of simple everyday situations, videos with native speakers) are still useful on Youtube, podcasts.
Each of our modules affects several aspects of learning at once: in the course of one lesson, the user can learn to speak English better, fill up his vocabulary, learn more about the cultural code of native speakers, and improve his speaking skills.
It may seem that this is too complicated, but in reality it is realistic - in life we do not use one skill “in a vacuum”, we combine it with other knowledge and competencies. So we can say that we comprehensively prepare students for existence in a different language environment.
But what about motivation?
Of course, in order to learn effectively, the user must always remain inspired and involved in the learning process. Therefore, the content of Puzzle English is interactive and personalized.
A significant part of the tasks contains a gamification element, and this one is also interactive. And you can go deeper into this topic: for example, automatically introduce game mechanics into educational materials. Turn on automatic training of words or expressions in podcasts, add tasks to identify missing parts of speech in reading texts, and so on. Now the educational process and games are successfully combined in courses according to the “Teacher method”.
There is a more explicit form of interaction - comments on phrases. Users can ask experts questions about the use of words, the use of grammatical constructions or translations and quickly receive answers to them. For many, this is a very convenient format for communicating with teachers: briefly and on business. In this case, of course, we strive to maintain the information content of sections and pages. So that general comments that do not carry any useful information for other users, we moderate.
And here, of course, it's time to talk more about personalization. In order for each user to feel direct contact with the service and to feel that we work with him personally, we offer a personal training plan, word training and classes according to the “Teacher method”.
A personal training plan is a central component of our entire personalization system. It connects the various modules and provides the user with a meaningful and effective version of the curriculum, taking into account goals, objectives and level of knowledge. When calculating a personal plan, we use machine learning technologies, a statistical analysis of the results of tasks and game results, as well as the history of user activity - we are not very actively considering the last point, but in the future we plan to develop in this direction and base the program, including on the history use of the service. But it is important to note: we only offer a trajectory, the student always has the opportunity to change the plan as his goals change.
Word coaching is based on forgetfulness curves or Ebbinghaus curves. In short: we take into account the proven fact - 60% of the information received, as a rule, is forgotten already in the first hour, after 10 hours of the studied everything remains somewhere around 35%, then the forgetting process slows down, and as a result, it settles in the head after 6 days approximately 20% of the initial amount of information. And these 20% are quite stable - they persist after a month. Of course, we take into account the individual characteristics of the student - the speed of progress, the volume of vocabulary and the initial level of knowledge.
Classes according to the “Teacher method” are also personalized. The user can change the trajectory of his training depending on his needs and goals. Very often in the process of learning a language, people realize that they are interested in some topic more than others. This is an excellent occasion to study it in more detail! We support such aspirations, including and excluding certain modules, courses, and exercises.
But only personalization and interactivity for motivation is not enough. In general, inspiration for new exploits is perhaps the weakest point of all e-learning services. For those who study remotely in free mode, it is not easy to get yourself involved. We solve this problem with the help of newsletters with reminders of tasks, thematic digests, messages about next tasks according to a schedule in a personal plan. There is also a bonus system of "puzzles" that complements the rating system - users earn bonus points for completing tasks of a personal plan, and then spend them in a special store. You can pay for the whole exchange rate with this domestic currency, but first you have to work hard.
conclusions
Based on our experience, we confidently declare that in e-learning the quality and usefulness of content is of great importance at every stage of training. Any educational service is created for students, and they are not interested in “bare” technologies. Fascinating formats, bright packaging, intuitive interface and the feeling of personal contact, along with the excitement of entertaining mechanics, easily convey educational material to users.
Now you know why content needs to be given so much attention (and what kind of content it can be). And in the following publications we will talk more about marketing at edtech. Stay tuned!
If you want to pump English, come to us
We give readers of the blog a coupon of 500 rubles for buying a subscription, which includes 8 types of training and weekly newsletters about English grammar and vocabulary. Participate in the promotion on March 8 to get even more pleasant bonuses.
And for unlimited and eternal access to all the features of the site there is an “All Inclusive” tariff (the discount is not valid).