Using Spark Apache A CSV file that contains following dataset 39086,47614,1,?,1,

Question

Using Spark Apache

A CSV file that contains following dataset

39086,47614,1,?,1,?,1,1,1,1,1,TRUE

70031,70237,1,?,1,?,1,1,1,1,1,TRUE

84795,97439,1,?,1,?,1,1,1,1,1,TRUE

36950,42116,1,?,1,1,1,1,1,1,1,TRUE

42413,48491,1,?,1,?,1,1,1,1,1,TRUE

You will use the following code

val parsed = spark.read.

option("header", "false").

option("nullValue", "?").

option("inferSchema", "true").

csv("linkage")

Question 17 options:

False

Parsed is

Question 18 options:

An array

A data frame

RDD

SQL table

Question 19 options:

1

0

9

10

True

False

  In the following code  

  val parsed = spark.read.  

    option("header", "false").  

    option("nullValue", "?").  

    option("inferSchema", "true").  

    csv("linkage")  

Parsed is

Question 18 options:

An array

A data frame

RDD

SQL table

  head contains first 10 lines of the dataset including the header row. What will be the output of the following.  

  head.filter(isHeader(_)).length  

Question 19 options:

1

0

9

10

Explanation / Answer

17-

Answer is True

It read the linkage csv file.

18 -

A Data frame

It read the linkage csv file and create data frame

19-

Answer is 1,

Because it only filter head row , and head row is one.

Related Questions

Navigate

• Browse (All)
• Browse U
• Subjects

---

---

Integrity-first tutoring: explanations and feedback only — we do not complete graded work. Learn more.