NEED HELP WITH CODED below this my code and the problem... and the dataset We wi

Question

NEED HELP WITH CODED below this my code and the problem... and the dataset

We will use a full day worth of tweets as an input (there are total of 4.4M tweets in this file, but you only need to read 1M): http://rasinsrv07.cstcis.cti.depaul.edu/CSC455/OneDayOfTweets.txt

Export the contents of the User table from a SQLite table into a sequence of INSERT statements within a file. This is very similar to what you did in Assignment 4. However, you have to add a unique ID column which has to be a string (you cannot use numbers). Hint: you can replace digits with letters, e.g., chr(ord('a')+1) gives you a 'b' and chr(ord('a')+2) returns a 'c'

Explanation / Answer

import sqlite3 import time start = time.time() # Open a connection to database conn = sqlite3.connect("Finaldatabase.db") # Request a cursor from the database cursor = conn.cursor() cursor.execute('pragma foreign_keys=ON') results = cursor.execute('SELECT * FROM USER;').fetchall() output = open('C:Gunjan DePaulCSC 455FinalsInsert.txt', 'w', encoding='utf8') for rows in results: insert = 'INSERT INTO USER VALUES (' for attr in rows: # Convert None to NULL if attr == None: insert = insert + 'NULL' + ', ' else: if isinstance(attr, (int, float)): value = str(attr) else: # Escape all single quotes in the string value = "'" + str(attr.replace("'", "''")) + "'" insert = insert + value + ', ' #print(insert) ID = str(rows[0]) uniqueSID = '' for j in range( len( ID ) ): uniqueSID = uniqueSID + chr(ord('a')+int(ID[j])) value = "'" + uniqueSID +"'" insert = insert + value + ', ' insert = insert[:-2] + '); ' #print(insert) output.write(insert) output.close() end = time.time() print ("Difference is ", (end-start), "seconds") #12.12 seconds conn.commit() conn.close()

Related Questions

Navigate

• Browse (All)
• Browse N
• Subjects

Integrity-first tutoring: explanations and feedback only — we do not complete graded work. Learn more.