Text Mining dan Web Mining


๐ŸŸข 1. Pengantar Text Mining dan Web Mining

https://images.openai.com/static-rsc-4/75qGmyphTHpN6Fr6nGlzQiqTayjPySqeXJBNx5L2GUzPnbrFwUmmSVZ5AL4DLzc7Jw-fdDF5y_Vj6mOIGDcxWpuNdTEC1520XQ9YvLLLk_-v4bKIzhIzghrG26R8WMyBNSqZxylBKJfYLLm4SwYDv1hoDLyquXX0hpeAQJBPikdEiKqeKxwhdtvQEk40Qkm5?purpose=fullsize
https://images.openai.com/static-rsc-4/uC2yYvJQqGmZYSZO_GNouK8SZLPXZI7tfYXO0xMYP_g_ZDmvRNxf-rZItSZVgsZk5Tv5sJ8IHhuQPu9aStsmki_mwIc9HVPgVHEI5BXVS38ZzFJcLHNXiHmZnx7VzWepzl5-2dsbC_Uj6hSkbKftWomN2dKY4zTyxtvD3PHWKvHugciQEBqb-1K7Vku1peNw?purpose=fullsize
https://images.openai.com/static-rsc-4/Gs80YIZeaf9ubkvZwXeYlHhda0s1j80_OeifPBBw3zYqMmOCIwZp89eEZSLsvWA6lv5o-RLztuD-4Y3N2colYHbkgKw2bmKUVj7RvMa0_1g4FJCriTZ0ckJnY2npXDeIPSsyznMavqwPdIckwR8ibpCqS8jQJfrfNlIts1DWr5AusLHkK0tHOYJlvLm1-oy1?purpose=fullsize

8

๐Ÿ“Œ Apa Itu Text Mining?

Text Mining adalah proses menggali informasi, pola, dan pengetahuan dari data berbentuk teks menggunakan teknik Data Mining, Natural Language Processing (NLP), dan Machine Learning.


๐Ÿ“Œ Apa Itu Web Mining?

Web Mining adalah proses ุงุณุชุฎุฑุงุฌ (penggalian) data dan informasi dari web atau internet untuk menemukan pola, tren, dan pengetahuan yang berguna.


๐Ÿ“Š Perbedaan Text Mining dan Web Mining

Text MiningWeb Mining
Fokus pada teksFokus pada data web
Analisis dokumenAnalisis aktivitas internet
NLPWeb analytics

๐ŸŽฏ Tujuan Text Mining dan Web Mining

<div style=”background:#eff6ff;padding:20px;border-radius:12px;border-left:5px solid #2563eb;”>

Tujuan Utama:

  • Menemukan informasi penting
  • Menganalisis opini pengguna
  • Menggali pola perilaku pengguna internet
  • Mendukung pengambilan keputusan
  • Membantu sistem rekomendasi

</div>


๐ŸŸข 2. Konsep Dasar Text Mining

https://images.openai.com/static-rsc-4/M5DH2V0b7s6xw0-WnkUHloEDIEjJvNbPYuVluOlQ6ZkYSoSGjvp180riMWGeKZF3BOxD_9Sx4ZAK3S0wBseaNMJmsHmnWgXaTylsLQ5KPHbYzNJ1Nxpordb7Vs7pkSwPorXuZec5e-wXyi-CWwgoulm-UrrPurThOSbdt73o_lCljue2krXsHzf-yfyd9oof?purpose=fullsize
https://images.openai.com/static-rsc-4/vWKHWlqY87g9jF-HxjWMd7vmckZ6feGPnxvPH00U234kj752FZHKhtZFQaDOhXlQEi4yDtFX6rIiUMSo1ALsJtsWSvSO9HcznwlEjwddublXEZrK8ejRypDjJwB_oWy98yHkBpjippqatzC3CuViT_qG7N1GfW-YzwEkZzCpUtBlxaHQKQZ8xvVgSUxrZPFH?purpose=fullsize
https://images.openai.com/static-rsc-4/TJiiFq5s793g__cdF-TvINvQiLlUC7qyMhsZzeWRSzMEGRsDJmwKUA1Gwl-45Le5DQG2fsCMkMW3X9lKHaGYLElAGXsjZLT_JqUbqSQ03gWWxqZQA7ArcqeZfi3EtKFNcZtrBvOs08kU9QYWCt4UXtmI_tu8JLvRb-f46xxyRTL5N1JfPzoC1455HoQuPSlN?purpose=fullsize

7

๐Ÿ“Š Workflow Text Mining

Text Data
โ†“
Preprocessing
โ†“
Feature Extraction
โ†“
Mining Process
โ†“
Knowledge Discovery

๐Ÿ“Œ Penjelasan

TahapanFungsi
Text DataSumber teks
PreprocessingMembersihkan teks
Feature ExtractionMengubah teks menjadi data
MiningAnalisis pola
KnowledgeInformasi baru

๐ŸŸข 3. Sumber Data Text Mining

https://images.openai.com/static-rsc-4/Mx4SG4pWTR2uNFXEOvTLKy4hf6-af9LaVTs_gQcc76X0di6O_KnWkcy2Euz8RLJz-ljHHDl_BIU2oBOhaMx-qm9iPlBC10ORu0ySALVSDdgSl3J9yK9pHDYjpHvpWYZt-8aiuKourGL7hzSwa9sAhLEJzqb63c1nyqUlkzLqEkbQXz5EPKHJyM4_SbEicfYE?purpose=fullsize
https://images.openai.com/static-rsc-4/rgdn5pdzQxP9Cp9mLMXREfmzMLQDZupKT6ytliSxoKDhnziAefnPavsiItOwVBp0BcAh0oNDkJ7iBXhAEe9n8ZX9klaul1N1Qo9f6ZCnWr4YzQlAYPCuVOcwD-zIYcoBZD8JFlLed1Ov8LzgWn11sFnMNDE0umiHlT2vb6T_EADntZbZaUm-ehsVjuILsfLS?purpose=fullsize
https://images.openai.com/static-rsc-4/PlXU8xXkKPiK1OeOk51KI63KeRDUZYTWAxXMud8q0WNnoD_J8_Iedw5kWJB3qICjTKCQqzhQgyQQJQEOtRSRgsholMMeGpEqZDbFBgY5KyYuM7c5DUf3iud7XRPfaOHqm1jWo8Ps-trO2EU2JE5Iqje-nHw_8Z_Hqm5IvucoRCEqAecVNokMJji-TDy15yDh?purpose=fullsize

8

๐Ÿ“Š Sumber Data Teks

SumberContoh
Media SosialTwitter, Facebook
WebsiteArtikel berita
E-CommerceReview produk
EmailAnalisis spam
DokumenPDF, Word

๐ŸŸข Contoh Penerapan

  • Analisis sentimen Twitter
  • Deteksi spam email
  • Analisis review pelanggan

๐ŸŸข 4. Tahapan Text Preprocessing

https://images.openai.com/static-rsc-4/1Mzprw9bxdmvY1Twi2cSsJ2RZeVZvVpoPAcgiGHcq6P15n5eKEHA0TOSQyJRvcBsdaxBCx1fWvZ4mXtEvNTd4BamJCFJUROBroxBJUZtVo1xi29UTg3nRdbVHXYwuy-ezpbQ0FX56qStqSg31zUibJveAPfU4TleEyopEaKVGZLtsKvt7Jyu1m9Acxyg44KO?purpose=fullsize
https://images.openai.com/static-rsc-4/WU_AIRPXHD_JZg5IGhctyYzkcXRpo-3-_gNHChCOWMHZa2M5lqIpuW6bFjKVdywkGw_IacV4KgqlpxgbKjcXXmP-821lVq9Jt_cpYieL15wLB9p17DBeplcC9Qt20XJIMp6i-nDHJjT5bsyn91p-7yrWckO4uKMphI9Vu0flWhjemcYOpexIKEB2ONIm0gfu?purpose=fullsize
https://images.openai.com/static-rsc-4/Ax-T8WjVR36Oq-g02VgWIMVMOs6AYfTQaIafHJxycYL_Bwxi-XWzuGmO3L1NP1-ON6ZenZDQhQDSA7cUvyDSh6Kty5LFfR5gopoCm1j9jY0Za-eC8CLDucTX4dbW6Pr11tnNos-5Jp6g2RkA0R2P_euM3Zj-jKcQNJY8BTAq7_mSEav2RuAQ9x9njzKfMDzA?purpose=fullsize

7

๐Ÿ“Œ Pengertian

Text preprocessing adalah proses membersihkan dan menyiapkan teks sebelum dianalisis.


๐Ÿ“Š Tahapan Preprocessing

TahapanPenjelasan
Case FoldingHuruf kecil semua
TokenizationMemecah kata
Stopword RemovalMenghapus kata umum
StemmingMengubah ke kata dasar

๐ŸŸข Contoh

Kalimat:

"Saya Sedang Belajar Data Mining"

๐Ÿ“Œ Case Folding

Hasil:

"saya sedang belajar data mining"

๐Ÿ“Œ Tokenization

Hasil:

["saya","sedang","belajar","data","mining"]

๐Ÿ“Œ Stopword Removal

Hasil:

["belajar","data","mining"]

๐ŸŸข 5. Feature Extraction

https://images.openai.com/static-rsc-4/pjZBg8RnL95_YXOYn8wWTPhNEpRsnW-DrviyFmlxqRdg22sgnGhnv4fvR5zeY-pCdE4NSmhUbdH2JSxQBFDoSBGzAj8VHKx6mwmiDwk5dwl0xKyXXK4vEj8t63DZwnp3JL8hGW3EUslmy-EIW_jXbrIExvSHFtOkplfboLbYFB59TvFBfbjbdE0kUKzstKGZ?purpose=fullsize
https://images.openai.com/static-rsc-4/lK-qGoBLqaf54Pf2BIcGD2BHKB0cep_SHPRGiLO_NXrqOTbyEC_eu_MJ8ZOZt1tRF1FY6PnNWfP1ryUO69nDTCdS-1cw58pGgUYloO6ZqCji6GhldT0ZKHsV2lz_Mmac2C1ZdqIHRyePWl6DP-kRDJwQ02Sl4iMG5GUgaoaXTndOTBpC5yKRCZ8Ej-X_NVE2?purpose=fullsize
https://images.openai.com/static-rsc-4/nPwRp3sAmgd-YAPzmadEBpBcDCuzE0npZGUw5DZ-aioenHoIWkJb1kUeWiLtoaQEKGX_GN6lFHj2SarfuOxmKtDoqpl_JdWJWIThbmXNoUBV_CQMBs6DDuaPeVPlA7U4yWYd_oteIWKHfD3BUQeet2u3yKWV-SHCkxCmFeM3FlcDB_154yfRwKn7FsQNcax6?purpose=fullsize

6

๐Ÿ“Œ Pengertian

Feature Extraction mengubah teks menjadi bentuk numerik agar dapat diproses komputer.


๐ŸŸข Teknik Feature Extraction

TeknikPenjelasan
Bag of WordsFrekuensi kata
TF-IDFBobot kata
Word EmbeddingRepresentasi vektor

๐ŸŸข Bag of Words

Menghitung jumlah kemunculan kata.


๐Ÿ“Š Contoh Bag of Words

KataFrekuensi
Data5
Mining3
Analisis2

๐ŸŸข TF-IDF

๐Ÿ“Œ Pengertian

TF-IDF digunakan untuk mengukur pentingnya suatu kata.


๐Ÿ“Š Rumus TF-IDF

TFIDF=TFร—IDFTF\text{-}IDF=TF\times IDFTF-IDF=TFร—IDF


๐ŸŸข 6. Text Classification

https://images.openai.com/static-rsc-4/cxxpM1baEbVPqyY-I0y32nj-8MdQvEEdtLXt2xW_0r3yEpg3JEyH2__vBM7-eA77jpqcc00tUEvX9vBBrP-b0lIaxtInc2Jqq52XEnYKzG3yChXS4wYhagZn-9kIsNeJFAftfLwwT9kH8UtpVpQQRsg-S1guk-loYW3KKg5nDw-8svB_X-iFmmuDyG_O5Mn1?purpose=fullsize
https://images.openai.com/static-rsc-4/dyyFPH16VVRkfBJwSBomPh_pqd_bbnZi3fM6GltwKIAGvK8_Q5R2iP8L5KY84ovHPtRESy58vCz1vb197asMJEk3w98XEl6jwAbv93u8gfUYyxZUbuAKfFET6Q_PW09Hc-ohyFLmN_LHWi7r531UtoE-d-EzqouXLytXSVsaccZw78c_ex-NkER26TgIdwir?purpose=fullsize
https://images.openai.com/static-rsc-4/GhtkiosBICpIzwrirsVOxsUeAwKzd98w0fxJgaSeJYRj_Fq073SjvO3ZJpWHGxmQfPRACbSckf7Z0O5PFq_OTa7KZRuYQ474NAYL7kz_ret6ecb7XgoqblMlj1lpcjXWxwqLQYy57VHf5gSLYpQqRx4-XBXq1S3Ccu6S9qElhrTCYs9mdna7hjl2eBf6GaCg?purpose=fullsize

6

๐Ÿ“Œ Pengertian

Text Classification digunakan untuk mengelompokkan teks ke kategori tertentu.


๐Ÿ“Š Contoh

TeksKategori
Promo diskon besarSpam
Jadwal kuliahNon-Spam

๐ŸŸข Algoritma Text Classification

AlgoritmaFungsi
Naive BayesKlasifikasi teks
SVMAnalisis teks
Decision TreePrediksi kategori

๐ŸŸข 7. Sentiment Analysis

https://images.openai.com/static-rsc-4/C95qjFYGvpnnODV9euwVFU-KFk_NnovzP1rw7gp9ztYLIIlZm2VXY9YgPtZtLMzsoTIotnuWrUSfLRHBRsx3JqKieVNnppDFH7jQBBIqhi7f3MXbkNAfRR5Y9sz7WVZyaZcOIyBP4b9LUA-j2dNP9VP7aBfHbyWdQMrslQ_Z9ncVxgpSJV8YMhqCONtMOmi4?purpose=fullsize
https://images.openai.com/static-rsc-4/J8T9KxV-Mmmrx69KW4U4jaKahSjbEA69N5QfllxidtVBdaQSnhvhNbQQelfWneCPMH7WD2YZ5UYoZoU1SPveX6o2qW6lfrDh8_kfDIsHz8vTKTHqYGC5i8088-1Wn5Fu-Q19v755nyRLCEXGqLIWLhLrz8WFURCLMbbcdSHsTeEm7sEb1RghzuHaPKqOXV53?purpose=fullsize
https://images.openai.com/static-rsc-4/IuewXKI6qTGJXgQioUA91g3psSrsXNxhUueQUTOnT_OMIxae7sQkirb2XxlfSSx4a6-aS8D858HYBDqiJhkfNWjKbhPKjF2EDdfJnBWNktxQIUtCv3W4JveBQTrZBcOwHFWJjnGaQPdQugqNy6zmFWWz16bzlcY2a0N6QJLWs5iUOyFHCOgAFqJDRdun9lNg?purpose=fullsize

7

๐Ÿ“Œ Pengertian

Sentiment Analysis digunakan untuk mengetahui opini atau sentimen pengguna.


๐Ÿ“Š Jenis Sentimen

SentimenContoh
PositifProduk bagus
NegatifPelayanan buruk
NetralProduk tersedia

๐ŸŸข Contoh Penerapan

  • Analisis review Shopee
  • Analisis komentar YouTube
  • Analisis opini publik

๐ŸŸข 8. Topic Modeling

https://images.openai.com/static-rsc-4/sxBdqvdq3QGtZIpulb2R5h5hK4gAgO8Awpy0a69trAW_Vih6-BHFV6Ztl3Ov-Ka6CUoeXaXmZqcKdcahmzJMNREfplk0mjnSCnF2823UopwbjBVvGOpuFKjxNDg7Hzd1yNE4lxSmoefXpfIUHTbrfgys7Bl_5DtkdFZkicJDvKWqP8J_kPnDmIaloWDDZjBm?purpose=fullsize
https://images.openai.com/static-rsc-4/OQJjgI4eIYGu10qctWYfzmNF_vpmoS8apGlU1tYD6lr33dRury2uALRaqW9EgIezo2jj4GHPQTRPBuXPias9z06S3McCN1ZITbfqYcju9GLUNASi2ad1WD0Nyk1KEtSfedx-dVxjYvepv3a3vHUCggPaNyMMjCA4z7ep171aPiRc90sTwmFzN33--6JceicJ?purpose=fullsize
https://images.openai.com/static-rsc-4/vV5pq50hyn_-CjoxSUS8mMYEeJkCNGglBvBqzIfeJ2CEAnZYxic4jDSz-xtOohVFq4kMbfhIqCaNAJ7R0U6Gw-G7QJcZTTjtQ2OyC95y9Ng1_M0-5bVK6fNeLU9jhqHVuHVKu5siHDyClFeVfH5SP9Iaj7DmrQTxjVtD60d7I2hWRh9VpIymKzM2yajpzxEE?purpose=fullsize

8

๐Ÿ“Œ Pengertian

Topic Modeling digunakan untuk menemukan topik utama dalam kumpulan dokumen.


๐ŸŸข Algoritma Topic Modeling

AlgoritmaPenjelasan
LDALatent Dirichlet Allocation
NMFNon-negative Matrix Factorization

๐Ÿ“Š Contoh

Kumpulan berita:

  • politik,
  • olahraga,
  • ekonomi,
  • teknologi.

๐ŸŸข 9. Pengantar Web Mining

https://images.openai.com/static-rsc-4/ZNYzs4C87QdoJieKBZ--_RwKw0oRAM4j9J2xjdfJ9s8WouwReIzOjtAvzhQY-xamWmp808vQGYNCsFM2Il0iX03jkfKnkjGvYQ97vFkVi6XikQGFMXfaw-iH2yeBBxzMrV5xbyI_pxCUz2fGHEmLEksvfdp503NXQ0rc-oj1q7EOXp9rt94ZaoT7_4dyQ_24?purpose=fullsize
https://images.openai.com/static-rsc-4/WaD6OW3wEKUrVW9cKxt2TSuSfudRALxQqT2aJXIOdsRvJuPeLavc7lMMRJ3K3W-9gUpZbCPx1RSLpFlonig8kWvIv8CamPzAGybY9B-GkTgFQeHwyoGlUz-y4QsCCH-IunOISeLjyH1lQjQf5toc_021BdEZcRLYs5ra_xd3_Q8KD4sANFPYCejDxUCY9cBD?purpose=fullsize
https://images.openai.com/static-rsc-4/IvEZrZD0s_iOdjPMJeQ67sdcRygxQLp3ZD_jArbg1YAoIVr9Lq9KqDwdinpF3JZyK5kwDgpwpa4fxOlmZ8fGE-AK36sF7Hwl_B8MQEZByzR5L0BSBq-cEYoVVdL-LQS3BFzbfqe8eByHVC7RJOYGOTouHGCGRO4yyo5ey1WVvBiKzy5Fht5MaSlfTByVzLv4?purpose=fullsize

6

๐Ÿ“Œ Pengertian

Web Mining adalah proses analisis data dari internet dan website.


๐Ÿ“Š Sumber Data Web

SumberContoh
WebsiteArtikel
Log ServerAktivitas pengguna
Media SosialInteraksi pengguna
E-CommerceData transaksi

๐ŸŸข 10. Jenis Web Mining

https://images.openai.com/static-rsc-4/uTRwMtvIQN1Evg9Ds8mCIOLKsw8DtB1nVhHEUjSF4K3X2Zxh3LTnkoZxu1bmJykj1fHaD9WH_LFgtvUjUCZOQU9CJHL9xpuKv7UoIylr7tHzHKWJIgk5Nw-it2yIujf9rD58hYzQ45uQI9GYD7Ni8hGEyyYHymyLBFgiSgU__e6jssnVn_Uc_G032RGZLb7H?purpose=fullsize
https://images.openai.com/static-rsc-4/CfjRjJsOnm7ENz-EI7zQNh-7wIMYK3HaC3yyPuaJenBnGVAiQh4UBIiWomytSZm6u9S-rul7r5hl6ZiumdaPsoROSwylF90EqPL5sysR_9fK2c7Nm3mSAChCEBSx5nLir69DuWJaUmoyBpi1gqd4ah0NuyVo6UQEPH1LhrlAYpujLmEyfh5zqzFuthokzEm8?purpose=fullsize
https://images.openai.com/static-rsc-4/J5FfP2Xt8pjtymw2O7DyZjl1pEYbq29xM6bwEEpDkTQ7GmbACVS8NSG1PWutQCxQYDWPdYTXaGNttbaH0Cf2Bg4cALnio2TadSCAZ1hpSpzTTLsT2vnT_BtWcruh4VMIIPOQqIX89F-2LagA8VrXfpuE_J4sessDmWcaax30UI5sbgxoiXsJ2u0LpxYWTgGr?purpose=fullsize

6

๐Ÿ“Š Jenis Web Mining

JenisPenjelasan
Web Content MiningAnalisis isi web
Web Structure MiningAnalisis struktur link
Web Usage MiningAnalisis aktivitas pengguna

๐ŸŸข Web Content Mining

Menganalisis:

  • teks,
  • gambar,
  • video,
  • dokumen website.

๐ŸŸข Web Structure Mining

Menganalisis hubungan hyperlink antar halaman.


๐ŸŸข Web Usage Mining

Menganalisis perilaku pengguna website.


๐ŸŸข 11. Web Crawling dan Scraping

https://images.openai.com/static-rsc-4/JJ4ftv1Uyn-bMk9K76zXWeJpWr50wsd8-5zml0ZHKGE3AwytmnFEaK-qgDGemHzcV0yDem0u98OoT6Z0ImCJyIroxLwcypwa6AIxrfCK_vKh0wPVoLcUFvHKHkLZW4TVFvsJATcKtfSqQWuQDY6NnBrudfPL_o2r9LZekTMtPRzxStJMjym3LqLsXd2DVEnc?purpose=fullsize
https://images.openai.com/static-rsc-4/ZAQfFwEugX72t8VVuGm7p5E0XmWfd4tzKUknsQxaIy3J-ZjsZA1fdXPHpaXDREKNo02qF2YeE9GPgG6UTw8Fji-pXiIYy49QBXuLesCJHKJxxkBBIV8AA6zTePd_BLYGO8DPSJMzSOPY5oM8VWMFFxnJXaa3BAzcB9uKhoEl7WEBO_BeXFH3tCIYR4KPzNIk?purpose=fullsize
https://images.openai.com/static-rsc-4/4JvtvHWMKopx0tooPOv8bbFU90muHu78ewiY43L0EYCz8fkChFk7aMmBk-0FnZdIAQcZebLwLEkGkU0QlR4bO-9d04jjS9wH0Mh3l7a8y9Jag_SDTz_9NV7FXeKngBwrsU0-CX11JSrsHmkWEOPkrEJiQEckCiWprSyvsMgkrrNbXf1p67jvbRLjF7yiue90?purpose=fullsize

7

๐Ÿ“Œ Web Crawling

Crawler menjelajahi halaman web otomatis.


๐ŸŸข Web Scraping

Mengambil data dari website secara otomatis.


๐Ÿ“Š Workflow Web Scraping

Website
โ†“
Crawler/Scraper
โ†“
Data Extraction
โ†“
Database

๐ŸŸข Contoh Penerapan

  • Harga produk e-commerce
  • Data berita online
  • Analisis media sosial

๐ŸŸข 12. Search Engine dan Web Mining

https://images.openai.com/static-rsc-4/CKa8PHZQwvKkJwOF-Rbsxkj15T1EoV4xYeEJQ6a1uoC8hYmGKhTir2UFZDCM6kb3fzK4imT9llQ7S0i3X7860vPu-lAaaRNtIR6KWZpBrgHcn7G0hgUH05HNCP4OeMZ3fl_QHbRs5SXjRhvnmDspu-MpcvdP_BAt_PIsP3kXY_IaWFQvcjCgup0c0YVjIUdr?purpose=fullsize
https://images.openai.com/static-rsc-4/Ib9L7dLRzKgpzk8fEC3KLCDQYkzF46JWUPfVyiZIjD1VjgKGtSMpxtyB2en8IzND-fDGwj5aBiIG8hhagPLdLx6cVNzrqBQDG0wJMaLbrWi3LAjFUOFCtpkwnmHGcN6WuaxYH-tgNAXH_4_INincGCqRWEn98Yc9S5RBh6J_mEUviZqa2QchQK1b75jpI21j?purpose=fullsize
https://images.openai.com/static-rsc-4/ZAQfFwEugX72t8VVuGm7p5E0XmWfd4tzKUknsQxaIy3J-ZjsZA1fdXPHpaXDREKNo02qF2YeE9GPgG6UTw8Fji-pXiIYy49QBXuLesCJHKJxxkBBIV8AA6zTePd_BLYGO8DPSJMzSOPY5oM8VWMFFxnJXaa3BAzcB9uKhoEl7WEBO_BeXFH3tCIYR4KPzNIk?purpose=fullsize

7

๐Ÿ“Œ Hubungan dengan Search Engine

Search engine menggunakan:

  • crawling,
  • indexing,
  • ranking,
  • dan web mining.

๐Ÿ“Š Tahapan Search Engine

TahapanFungsi
CrawlingMenjelajahi web
IndexingMenyimpan data
RankingMenentukan hasil pencarian

๐ŸŸข 13. Tutorial Text Mining Menggunakan Python

https://images.openai.com/static-rsc-4/rjq7phYvSLeDVsUw8X0QknRgLbkzJxyqzWXjxly6LJd3EG1skeHHvAU7XEGxnVTngSDbFm1k4xpK3hNhyjUkzHdoBIsyXDiaVZ1QFf-DqGcklI3UlgoVZiEvbJPu0Xy51PsAZdcDTvvGb02XWv3jefAGavCSCyDFWCCsdQLkN0K3iE4mgngv6VIU9XXWrwCn?purpose=fullsize
https://images.openai.com/static-rsc-4/8d7bYyU3NagIoMfjnNdtuoztxP99oAxwp8EmruPmpqEl9x9OWEoKtQIiGL2a01Stn9zvUTZJxsxxQ0KeOAisDe5t4O9CrDb_O0IIgo0X0e_mtniREc2zLhrJ_t4ncy5Fopc78atI9JlJr9RNDtrpJs-1_j03MMk56psc1l1CRb1SmFXZMdC5uRAblX_MaLcX?purpose=fullsize
https://images.openai.com/static-rsc-4/BAuE8x9pvcv3UZ8okzYuutnnhbraCzv0fOBNZHOAAfnn0CriZcoonz-03CVnfzhPGTBuk7LSSWz8dcni-qAcfbKIFU_kN0MwZBu5hKA7lYGWAnkX4y7bKcWO8ftMtcM5BK1lpBIUaNaIvnX7f-7IoxVe31i5LlL4EPuADk0vl-0sqfMwRJW1fZrxpw0LNL7U?purpose=fullsize

8

๐Ÿ“ฅ Langkah 1 โ€” Import Library

import pandas as pd

๐Ÿ“‚ Langkah 2 โ€” Import NLP Library

from sklearn.feature_extraction.text import TfidfVectorizer

๐Ÿ“Š Langkah 3 โ€” Dataset Teks

text = ["data mining sangat menarik"]

โš™๏ธ Langkah 4 โ€” TF-IDF

vectorizer = TfidfVectorizer()

๐Ÿ“ˆ Langkah 5 โ€” Transformasi

X = vectorizer.fit_transform(text)

๐ŸŸข 14. Tutorial Web Scraping Menggunakan Python

https://images.openai.com/static-rsc-4/7p1qdP6RMzrEHvJ26yxY-Tq1WFSCfjpwX3qdk7uZVJSuZOU0qCr_kP3ZJyQjZaHrCqxABJ6YjNQrQTjhDQGFM30Ppxzjs3isF5hNRnO3QMEQthYGZZTocTfTNSdRDolWSl28YfqJjjXV8e_mYpSB7PbWJWjQhORmv3_9mvpZFQw5mGYAFWBqczwOj6SiJfC9?purpose=fullsize
https://images.openai.com/static-rsc-4/OqkcycmdhJ5tO-3glPvZ_Ycgm14PVk3BjL8ovZGQU7ht9i0V58-F9JkZuTnqge3ZSfDUaWVIyQR-e73gqPBC3RWtUkfnOnNtB9jUmFiHeJfI1rW_eLvLBspDa9PQLkzTtSudjb1eSojP373FWi6Kne2qPDq-pRiyqu-uQHROZu-fF7EqMrWluRAYjHo4hepd?purpose=fullsize
https://images.openai.com/static-rsc-4/Xpl4iBduQPPkXFTkBaNhRE0k30ndgrmZtI0m4pZXQqmdV7qvsDAIM2imJBSOvpDwrC6VrDDbxDzJ_hw7-1xlfMA1UpxTeTyvcz7ipECtMk4az1dtG9C4EHS4N0IX7FRBe-2PC8RRID0HbliU0-2oyMUgErD9fZ_phF5XFxMoNP3oTElDdNfEb_JjuO93Dfdc?purpose=fullsize

7

๐Ÿ“ฅ Langkah 1 โ€” Install Library

pip install beautifulsoup4

๐Ÿ“‚ Langkah 2 โ€” Import Library

from bs4 import BeautifulSoup

๐Ÿ“Š Langkah 3 โ€” Membaca HTML

soup = BeautifulSoup(html, 'html.parser')

๐Ÿ“ˆ Langkah 4 โ€” Mengambil Judul

title = soup.title.text

๐ŸŸข 15. Studi Kasus

https://images.openai.com/static-rsc-4/sXtY9GSCxmDuUy7PwzXlKj0RJwGZH_qK12Z_XRyquhtuXt0MVt6KC7kkGJwmjHv_DzAf6F1keTWphO3ogOG4bxFy2qDW4PpRpigg3JIngM7cb7UmK2b7gREZtQuVLouGDqBDMBAlUCcveiRg0WxPL1KH1lGzlSOR_pLJAEPEPbfU6Jx0UJooc_EoqWS9ADKo?purpose=fullsize
https://images.openai.com/static-rsc-4/C17OhJMcNYsPy-cJ6uGJK2Gsu9XkJpNWkZ2LAUz-Ri5RDkDx7kWuT2kWJ1SORiNJZYsLLIhq57dKrzgYZEOgnQDGOC7ZC9XtzuzBgPxVUZDsfsrgdp2EuoekJ2TjONFlriv1gnbV5kCNKDQ3IcfSdUXEQ-mQwAElXcemmHBNKtvUhfmcnLKiw5TjpC-0pV76?purpose=fullsize
https://images.openai.com/static-rsc-4/rgdn5pdzQxP9Cp9mLMXREfmzMLQDZupKT6ytliSxoKDhnziAefnPavsiItOwVBp0BcAh0oNDkJ7iBXhAEe9n8ZX9klaul1N1Qo9f6ZCnWr4YzQlAYPCuVOcwD-zIYcoBZD8JFlLed1Ov8LzgWn11sFnMNDE0umiHlT2vb6T_EADntZbZaUm-ehsVjuILsfLS?purpose=fullsize

7

๐Ÿ“Œ Kasus Analisis Review Produk

Dataset:

  • Review Shopee
  • Komentar pelanggan

๐Ÿ“Š Tujuan

Mengetahui:

  • kepuasan pelanggan,
  • sentimen positif,
  • dan kritik pelanggan.

๐Ÿ“ˆ Hasil

SentimenPersentase
Positif70%
Negatif20%
Netral10%

๐ŸŸข Insight

Perusahaan dapat meningkatkan kualitas layanan berdasarkan analisis review.


๐ŸŸข 16. Tantangan Text Mining dan Web Mining

https://images.openai.com/static-rsc-4/TJiiFq5s793g__cdF-TvINvQiLlUC7qyMhsZzeWRSzMEGRsDJmwKUA1Gwl-45Le5DQG2fsCMkMW3X9lKHaGYLElAGXsjZLT_JqUbqSQ03gWWxqZQA7ArcqeZfi3EtKFNcZtrBvOs08kU9QYWCt4UXtmI_tu8JLvRb-f46xxyRTL5N1JfPzoC1455HoQuPSlN?purpose=fullsize
https://images.openai.com/static-rsc-4/d1wszEc0bPZiao-jEc_iP1LEo36Qf0H_BkXmD81edCsS_6K5OGb_bC5wMutGBoMzmSV3gSB2m5fR2r83dWyXouZBNL-jk86pbfsT9U198wQejzA44fq8zUA80Qk5L6kqmhqQlmAF0tAiz431QwzcDRjqSMkwlHCgb2ca-lrM2FDoA1-XEy57auo928VAE7UT?purpose=fullsize
https://images.openai.com/static-rsc-4/Qxu2fQUCoif5mWzOy5H9Kkrg-jJrEEGJMm9c0D06SUmhZIpHggu4BSAmZMhHsIRSHFbjIJ2T67zb730b95yMgugwilwajLFsXUkllxzzIHo5psuo4x_Pf65YlUjiGqBLKx0QzQWo0ZPpgdfXyULQ08C6KLbBEuBPKH9VTagjh8PqhuavHHHH6Lg0p2f6qLq7?purpose=fullsize

7

TantanganPenjelasan
Big DataVolume besar
Bahasa ambiguMakna ganda
Noise dataData tidak relevan
SpamData palsu
PrivasiKeamanan data

๐ŸŸข 17. Kesimpulan

https://images.openai.com/static-rsc-4/PqXeaIVV_FNbMhua_vYBjlxibwVzk7LpFBQCtWJ2aY1StNc9ZtBaZ1agZNsGHBUG5cDYXG4bo4CJlOggYOBM-CiYBanp8-im2KOpeINQEqZpZncpcOAa_pHGlu9PtgR-lcbehOiusiXOmL_gU_X-d5kLCb5cDhO0P5yLrGPkVqcKO5CJwvvXcQiVRv7HR7h-?purpose=fullsize
https://images.openai.com/static-rsc-4/s-PJGpB4tULbElJSk_62XnGTt90zws08aHNdmhseUii6lGVimj6NHMvkLQoZiuBIW9Bhmt0EpoAT0ankd7h0X47Sn1bc_wFTyTBAozQKJ5n9qxAduUPO7rlFGtkZWSsLiwhKNDjB1G6YYSIZ7SpLAv4Gs4hQTSruOnNDNrnMV3kGZggJr2BmjgKVknytljys?purpose=fullsize
https://images.openai.com/static-rsc-4/4jUoh-bpXl_sM9n-WRY9TylLKO-bo9p-zugL-B60BEfEQPJ4dBAHEKXZnBoRJztfuwiJdqpnEdaEZXijCP2DIV0IQztIZVoYFLFX8MNQo-lBwAY-MHuZlSefG4BgX_CBIf9V2uXwDJUtRf1WlClo1xx4V5yvVFv2X54FjmM-Rke_o8pVaZef4JkGKxYPLWZd?purpose=fullsize

5 <div style=”background:#111827;color:white;padding:25px;border-radius:14px;”>

โœจ Ringkasan Materi

Text Mining dan Web Mining merupakan cabang penting dalam Data Mining untuk menggali informasi dari teks dan internet.

Teknologi utama:

  • NLP
  • Machine Learning
  • Web Scraping
  • Sentiment Analysis
  • Topic Modeling

Penerapannya sangat luas pada:

  • media sosial,
  • e-commerce,
  • search engine,
  • pendidikan,
  • dan Artificial Intelligence modern.

</div>