

这里是 Daisy 2024年9月的每日总结。
这篇博客存在的目的是想让自己养成记录与总结的习惯,希望能够通过写作这一途径对自己一天的学习生活做一些简单的总结与反思。
2024.9.30
终于迎来了十一小长假,小小的放了个假。
复现 Transformer 的计划仍然在进行,对于 decoder 中的 mask 机制,仍然有一些疑问,明天整理心情解决一下。
明天加油!
2024.9.29
风大雨大,但是还要去教室,鞋湿,心累。
朋友说,西安每到十月,总是会下雨的,但去年国庆的回忆,我却依然模糊,一年的时光飞逝,而我却没有留下多少值得记忆的瞬间,很是感慨。
写博客的意义也许就在这里吧,对一天的生活留下一些记忆的碎片,在几个月后甚至几年以后,也能偶尔回回头,看看自己曾经走过的路。
今天也还在继续完成复现 Transformer 的计划,完成了ffn、multihead cross attention 等 mechanism,也完成了了 transformer pipeline 中的 encoder、decoder的组装,进度还算过得去,就是博客上相关的部分还没有跟进,放在明天完成。
其实这个计划一直憋在心里许久,但一直觉得自己技术水平不够没有动手实施,如今也是跟着前辈的教程、博客等等推进复现计划,自认为达到了很好的学习效果,更清晰地了解了这个里程碑模型的内部结构,也慢慢揭去了 Transformer 的神秘面纱,还蛮有成就感的。
事实证明,一个人的准备永远不可能做得足够充分,当你觉得自己可以做到的时候,尽管动手去做就好了!正如李沐大大说的一句话:深度学习怎么学,动手学就是了!
明天继续加油!
2024.9.28
今天实现了 Transformer 的一些小trick,比如 multi-head attention、positional encoding 等,也完善了博客的相应部分。除此之外的工作,基本没有很大的进展,心累,自制力还是差了。
晚上和朋友出去吃了烧烤,打了台球,虽然腰酸脚麻,但也算是丰富了一下周末的体验,一直宿舍教学楼两点一线,生活难免枯燥。
还是得明确一点,没必要在意别人的眼光,做好自己就行了。就算别人的风言风语让你感觉不舒服,不去理会就是了。
停止内耗,认真学习,才是一个大学生应该要有的精神品质!
加油!!!
2024.9.27
这两天对往后的规划做了一些思考,为了丰富自己的简历,还是得做一些有价值的,能学到东西的任务。我做了一些思考,既然已经在cv领域做了一些初步探索,我想借着学习 transformers 包的契机,复现一些经典的算法,于是开了一个新坑,从经典模型 Transformer 开始,争取一周复现两个经典算法,并将其方法整理进博客。
我的一周目标:
- 至少复现一个经典算法。
- 至少阅读五篇顶会论文。
- 至少完成一场 Kaggle 竞赛。
- 至少完成一个 github 入门项目。
距离推免还剩一年,该让自己忙起来了。
2024.9.26
我的博客进入了近五个月的中断期,虽然感觉很忙,但其实收获并不是很多,还是要提高时间利用率!
昨天参加了国奖答辩,不出意外被筛了,不过本来就是冲着体验与锻炼去的,意料之外的不是非常紧张,感觉临场发挥不错,较为满意~
这两天我更换了博客框架,选择了更加user-friendly也更简约耐看的Keep主题,也希望我像主题名字一样,不断keep moving吧。
2024.5.3
This days I spare myself from the burden of study, and really have fun with my friends in games. But with the final exam approaching, I should put more attention on learning. What’s more, make sure at least read one paper a day.
Finally, I received a very good news this morning, which is our team had won the Meritorious winner at ICM contest, I believe my joy was more than anyone can imagine.
May I continue to give myself the joy of success in continuing to ascend like this, and wish me good luck tomorrow and everyday!
2024.4.28
Zero progress in Paper reading, which is not good.
I should and i will give up playing games tomorrow, and focus myself more in study.
I start my learning at kaggle platform, which will be beneficial for my data science study, i think, and i have finished several couses of MachineLearning for beginers.
I also complete my learning at FreeCodeCamp Chapter two, which is also about string manipulation, i learned some useful skills.
Tomorrow is a new day, since i have determined to be a better person, than i should be more devoted in my study!
I hope everything going well tomorrow.
2024.4.27
Paper read:
- Generative Adversial Nets(GANs)
- Coming Down to Earth(Geo-localization) [uncompleted]
Code Practice:
- FreeCodeCamp – Python Scientific Computation
Episode1 completed(String Manipulation)
2024.4.24
Today, I finished installing the Virtual machine with Ubuntu22.04 in my computer.
Tried to change mirror source
sudo cp /etc/apt/sources.list /etc/apt/sources.list_backup
backup my sources list in sources.list_backup
when i use wget + url
to fetch the pack of anaconda3 in a shell, i failed with an error
Proxy request sent, awaiting response… 403 Forbidden 2024-04-24 21:27:34 ERROR 403: Forbidden.
i tried to replace the source list with Tsinghua Source mirror, but it didn’t work out
finally i managed to install anaconda3 by using the following command:wget --user-agent="Mozilla" + url
due to the server will reject an user proxy which is not begin with Mozilla or not including Wget.
my anaconda3 position:
/home/mingkun/anaconda3