precision recall f1-score support
0 0.73 0.44 0.55 1259
1 0.60 0.83 0.69 1241
accuracy 0.64 2500
macro avg 0.66 0.64 0.62 2500
weighted avg 0.66 0.64 0.62 2500
Accuracy (validation): 0.6364
The accuracy with 15 words was abysmal. The accuracy with 1500 words is pretty bad, but at least it's better than random chance. What does our vocabulary look like?
Vocabulary somewher, read, film, suppos, comedi, see, call, anyth, point, movi, dialogu, extrem, absurd, mani, set, seem, despit, nuditi, sexual, content, noth, leav, wonder, thing, titl, premis, could, fun, polit, instead, re, treat, cheap, weird, want, ll, buy, grace, jone, first, comment, imdb, reason, write, talk, one, best, ever, make, laugh, cri, time, fall, love, not, fan, yet, sing, tradit, possibl, accept, exist, feel, good, watch, like, lot, actor, non, lead, role, creat, memor, charact, interest, import, central, star, great, rememb, everi, singl, face, around, find, line, becom, name, speak, peopl, live, simpl, deep, guess, meant, sort, beauti, say, ve, began, sever, minut, graphic, sex, wow, anyway, young, woman, travel, marri, son, owner, man, take, care, sure, get, rock, legend, area, rather, ladi, least, particular, kind, refer, away, regard, soon, to, curious, littl, hand, father, sight, goe, sleep, famili, wait, show, member, dream, wood, way, effect, desir, attempt, know, much, laughabl, especi, certain, featur, appear, realist, bed, post, strang, twist, end, realli, clue, build, fit, definit, expect, tough, moment, think, everyth, theater, death, awesom, use, dull, stori, follow, girl, hope, th, part, came, straight, video, kill, boy, base, mother, visit, mom, boyfriend, move, tri, writer, turn, anyon, hous, danger, give, worth, blood, dvd, disappoint, european, horror, almost, redeem, qualiti, except, thorough, entertain, bad, open, alon, heroin, dr, arriv, help, scientist, experi, dead, rape, fight, final, near, next, day, someth, tell, would, place, decid, stay, put, even, enjoy, event, over, the, top, knew, go, this, but, repeat, drug, night, nake, tortur, mild, convinc, angri, complet, negat, includ, obvious, fact, popular, women, work, mind, pretti, someon, basic, physic, brother, respons, long, wind, scene, warn, involv, suffer, well, cours, brief, marriag, shot, local, surround, hurt, two, killer, whole, quick, blame, idea, subtl, ridicul, predict, climax, bore, director, anoth, hit, head, made, realiz, hear, funniest, bit, dub, endless, product, valu, close, credit, red, class, music, sound, sometim, tim, add, odd, cloth, standard, rate, solid, pleas, must, left, taken, aw, victim, may, dare, lie, so, posit, messag, shown, need, societi, throw, stand, went, wrong, portray, weak, strong, against, famous, usual, full, hide, learn, mean, clean, though, light, whether, daughter, thus, confus, subject, simpli, funni, wooden, mediocr, track, bright, pointless, overal, viewer, god, save, match, edg, also, michael, main, honest, fell, worthi, joke, big, miss, earli, probabl, found, still, warm, wast, back, floor, half, crap, screen, that, wit, field, hour, might, better, spent, act, plot, saw, cut, seen, manag, escap, ride, background, old, king, desper, clear, heavi, will, front, money, review, pain, done, justic, type, word, let, look, flick, pass, walk, car, start, anymor, buddi, mine, sent, girlfriend, come, what, wors, twice, heard, ball, month, real, life, struggl, win, emot, friend, sister, jane, thi, focus, loos, special, rise, incred, intens, ultim, america, memori, childhood, promis, remark, perform, establish, claim, support, youth, sport, program, award, alway, told, age, proper, key, never, recommend, within, believ, achiev, rest, piec, bottom, cinemat, food, play, in, anim, aliv, spot, often, small, eat, monster, slowli, crazi, stupid, destroy, new, ground, gore, element, clever, script, plenti, lin, cult, violenc, middl, fine, italian, pick, deliv, express, suggest, mak, wife, job, beyond, hold, you, scream, teenag, horribl, teen, poor, male, femal, absolut, hate, sit, garbag, dad, room, depress, worst, detect, happen, mysteri, fiction, die, year, ago, wish, finish, mix, releas, cast, gave, everyon, els, state, latter, amaz, quit, career, ahead, question, person, last, festiv, huge, storylin, potenti, power, excit, reveng, check, conclus, stick, classic, yes, dialog, flat, right, depict, colleg, world, serv, purpos, serious, lack, lame, photographi, impress, inde, break, either, admit, mayb, club, longer, version, bar, american, fire, blue, general, decad, atmospher, prove, terribl, ask, abus, polic, jame, less, regular, execut, and, children, profession, home, enough, countri, perfect, got, road, howev, black, magic, comparison, meet, display, alreadi, develop, understand, visual, silent, forward, drama, without, talent, stun, imag, fill, arm, box, handl, of, view, far, insight, later, object, parti, offer, happi, relationship, ring, episod, artist, behind, rare, mistak, affair, free, annoy, cute, hero, coupl, bond, etc, previous, therefor, maker, mad, creatur, nightmar, histor, chang, industri, normal, impact, upon, audienc, refus, satisfi, sudden, pathet, opportun, million, five, earlier, took, imagin, entir, disappear, eye, actual, run, down, system, consid, biggest, guy, along, begin, problem, crime, respect, deserv, amount, keep, deal, exact, surpris, besid, david, order, pull, distract, up, nice, inform, action, outsid, hilari, case, discov, now, white, matter, direct, thank, exampl, due, abl, jump, high, on, design, doubt, aspect, camera, second, said, bare, stage, decent, low, budget, craft, mention, equal, modern, sequenc, although, abil, easi, thought, bill, differ, style, origin, commentari, intellig, answer, band, natur, assum, truth, requir, pop, cultur, group, public, fascin, agre, sinc, remain, most, art, produc, anywher, record, theme, nobodi, it, cop, initi, shock, fate, cheesi, soundtrack, cool, suit, song, fantast, pay, hill, whatev, martin, pleasant, formula, japanes, stuff, insan, camp, level, genius, ther, allow, discuss, edit, today, favorit, appeal, don, german, unlik, eventu, dark, frighten, fail, greatest, disney, heaven, masterpiec, damn, suck, chill, realiti, practic, if, concern, york, child, hidden, sick, explor, various, flashback, other, gorgeous, men, fast, true, church, spoiler, boss, drag, forc, rip, human, market, psycholog, excel, angl, late, avoid, pictur, touch, hard, romant, older, issu, okay, kid, adult, doctor, extra, bring, fear, evil, brought, faith, seri, scari, return, 10, among, unfortun, stretch, movie, notic, wrote, screenplay, consist, materi, appar, result, cliché, exploit, co, three, school, trip, enter, past, color, spend, togeth, none, student, husband, date, immedi, hire, actress, continu, attract, lik, bodi, voic, spoil, nation, given, creativ, concept, describ, hollywood, soldier, armi, govern, murder, detail, door, obsess, across, compar, critic, sorri, shine, unbeliev, compel, theatr, explan, credibl, drawn, draw, addit, unit, team, shoot, stereotyp, plan, space, genr, land, written, richard, pair, tale, approach, out, situat, sens, wild, iron, held, pre, georg, round, compani, chanc, share, worri, fashion, inspir, piti, reach, avail, sequel, ghost, babi, figur, tire, sad, outstand, crimin, story, known, gem, alien, possess, reveal, for, sign, note, send, third, war, suspens, explain, english, languag, depth, spirit, whose, sub, success, readi, tom, imposs, noir, narrat, villain, lord, giant, pure, hint, loud, stop, summer, somehow, short, brain, burn, test, john, side, violent, report, somewhat, crew, offic, cost, born, appropri, rule, phone, hair, slasher, mid, lesson, troubl, west, control, similar, tast, soul, humour, favourit, prefer, christian, grant, four, nonsens, indian, cross, danc, progress, perhap, thriller, jack, master, mental, tension, term, air, week, appreci, comed, dramat, rent, store, opinion, tragedi, number, cameo, silli, fantasi, generat, comic, book, ad, onto, score, contrast, romanc, engag, sell, otherwis, mari, self, seek, ruin, provid, mess, paid, locat, hospit, amus, filmmak, scienc, doubl, larg, attack, grow, caus, mouth, constant, throughout, charm, cover, water, wall, forget, excus, insid, surviv, truli, chemistri, former, remind, technic, highlight, bunch, heart, fulli, difficult, vision, led, familiar, recogn, intent, cinematographi, breath, deepli, south, gay, kept, intern, cinema, hole, felt, apart, plus, receiv, center, flaw, accent, histori, remak, reaction, superb, slight, disgust, moral, essenti, skill, ten, succeed, project, forev, relat, zombi, effort, length, frame, aim, current, thrown, angel, magnific, occasion, celebr, lock, rais, accid, brutal, nasti, frank, neither, nowher, shame, british, zero, mi, citi, sceneri, major, documentari, motion, toward, tend, pace, haunt, utter, model, creepi, christoph, terrif, drop, christma, dread, western, island, mood, opera, caught, unknown, present, tie, earth, accur, frustrat, captur, necessari, studi, mark, fellow, vampir, lost, recent, trailer, bought, list, costum, process, period, desert, robert, street, town, strike, steve, smith, ex, evid, trust, intend, occur, easili, choic, common, adventur, combin, manner, smile, search, train, battl, teacher, board, yeah, push, charg, convers, step, form, grade, typic, footag, drive, militari, brilliant, chris, joe, fair, van, afraid, do, humor, unexpect, wide, innoc, thrill, insult, commerci, cold, collect, bother, sentiment, pleasur, parent, rich, off, total, al, season, sum, scare, tone, steal, fresh, era, roll, rat, sexi, dog, toni, hell, stone, skip, beat, sam, scott, busi, fool, tune, sweet, game, individu, william, mr, listen, hey, jean, park, prepar, bloodi, hang, univers, logic, contain, folk, anti, everybodi, met, rang, separ, somebodi, choos, unusu, wear, favor, blow, remot, protagonist, accord, random, averag, gun, peter, ben, connect, idiot, prison, super, hunt, dollar, trash, televis, catch, conflict, interview, author, station, london, copi, challeng, disast, gone, replac, seat, bizarr, plain, trick, asid, tragic, smart, adapt, repres, paul, embarrass, all, paint, attitud, won, awar, wise, kick, influenc, superior, tear, irrit, improv, vote, commit, suicid, thin, oscar, news, anybodi, character, crash, planet, watchabl, hot, cat, glad, futur, rush, carri, blond, decis, likabl, root, sci, fi, becam, stuck, partner, judg, forgotten, slow, window, trap, limit, complex, unless, cartoon, player, attent, agent, investig, chase, join, fake, shop, channel, race, gang, harri, six, uniqu, journey, affect, centuri, teach, seven, count, lover, lose, drink, encount, gag, ignor, satir, quiet, novel, studio, serial, bland, bear, law, protect, correct, secret, tape, mere, comput, lee, minor, charl, delight, ann, resembl, machin, no, her, ill, intrigu, ship, younger, opposit, stephen, energi, billi, social, motiv, photograph, fortun, ident, liter, fli, passion, green, ugli, load, suspect, signific, disturb, target, instanc, mile, strength, marvel, unnecessari, bomb, them, genuin, introduc, dress, dumb, presenc, independ, rescu, french, epic, admir, invent, jim, reflect, ray, nomin, joy, pack, fault, convey, whatsoev
Does this look like a list of words that would determine sentiment? Yeah, more or less. Because it's 1500 words, it's pretty nuanced I bet.