[ch-03] match Error with function: buildArtistAlias about aas

[lizhili]

And the alias text file looks a little strange, two line split with ' ' and '\t', some rows get empty first column.

6706632 1000881
6706633 1000881
(\t) 2011821
7023776 2011821
6706635 1000881
10048635(\t) 1063056
6711643 1000881
6711659 1000881
6623938 1000881

[srowen]

Can you paste or point to the code you're running? the method that reads this file should cope with those errors:

  def buildArtistAlias(rawArtistAlias: Dataset[String]): Map[Int,Int] = {
    rawArtistAlias.flatMap { line =>
      val Array(artist, alias) = line.split('\t')
      if (artist.isEmpty) {
        None
      } else {
        Some((artist.toInt, alias.toInt))
      }
    }.collect().toMap
  }

[lizhili]

When i restart spark shell and just execute the read alias text and build alias part.
Success.
Sorry. I remember i tried lot times last week.