Sonoma State University
Department of Computer Science
CS-460: Programming Languages
Exercise 2a: Tokenization

Objective:

In a team of three or four students, list the tokens and token type (e.g. String, Integer, Right Parenthesis, etc.) which comprise the program below. The program below is defined by our C-like programming programming language.

How do I know what a token is?

Please use the document, Definitions for tokens in Backus-Naur Form.

Please use the following program to identify and label tokens:

procedure main (void)
{
  int counter;
  int state;

  counter = 1;
  while (counter <= 100)
  {
    state = 0;
    if ((counter % 3) == 0)
    {
      state = 1;
    }
    if ((counter % 5) == 0)
    {
      state = state * 2 + 2;
    }
    if (state == 1)
    {
      printf ("Fizz");
    }
    else
    {
      if (state == 2)
      {
        printf ("Buzz");
      }
      else
      {
        if (state == 4)
        {
          printf ("Fizzbuzz");
        }
        else
        {
          printf ("%d", counter);
        }
      }
    }
    counter = counter + 1;
    if (counter <= 100)
    {
      printf (", ");
    }
    else
    {
      printf ("\n");
    }
  }
}

Submission Instructions:

Since this is a group assignment, please write the names of each member of the team student on your assignment submission along with "Exercise 2a: Tokenization".

Exercise 2a Rubric

CRITERIA RATINGS POINTS
Tokenization Proficient
10 points
A partial or complete list of tokens is labeled and identified which are relevant to the assignment guidelines above.		 Below Expectation
0 points
No solution submitted.		 10 points
Total points: 10