🌐 Mailman 3 September 2019 - scikit-learn - python.org

Re: [scikit-learn] scikit-learn Digest, Vol 42, Issue 14
by Sayak Paul Sept. 13, 2019

Sept. 13, 2019

I was able to solve the problem using - mlb = MultiLabelBinarizer() mlb.fit([y_train]) Thanks for the suggestions. The output of mlb.classes_ now looks the following (first ten classes): [image: image.png] However, when I transform it using mlb.transform([y_train]), another problem arrises - [image: image.png] Kindly suggest :) Sayak Paul | sayak.dev On Thu, Sep 12, 2019 at 9:33 PM <scikit-learn-request(a)python.org> wrote: > Send scikit-learn mailing list submissions to > scikit-learn(a)python.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://mail.python.org/mailman/listinfo/scikit-learn > or, via email, send a message with subject or body 'help' to > scikit-learn-request(a)python.org > > You can reach the person managing the list at > scikit-learn-owner(a)python.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of scikit-learn digest..." > > > Today's Topics: > > 1. Re: MultiLabelBinarizer gives individual characters instead > of the classes (Lo?c Est?ve) > 2. Re: Vote on SLEP009: keyword only arguments (Guillaume Lema?tre) > 3. How can I enable line tracing for cython modules. > (Alejandro Javier Peralta Frias) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Thu, 12 Sep 2019 07:24:48 +0200 > From: Lo?c Est?ve <loic.esteve(a)ymail.com> > To: Scikit-learn mailing list <scikit-learn(a)python.org> > Subject: Re: [scikit-learn] MultiLabelBinarizer gives individual > characters instead of the classes > Message-ID: <vnokwoeeozmn.fsf(a)ymail.com> > Content-Type: text/plain; charset=utf-8 > > I think this caveat has been added in the dev doc (not yet in the stable > doc). You may want to read: > > https://scikit-learn.org/dev/modules/generated/sklearn.preprocessing.MultiL… > and in particular the part that starts with "A common mistake is to pass > in a list". > > Cheers, > Lo?c > > > Hi. > > > > I am working on a Multi-label text classification problem. In order to > encode the labels, I am using MultiLabelBinarizer. The labels of the > dataset look like - > > > > image > > > > When I am using > > > > mlb = MultiLabelBinarizer() > > mlb.fit(labels) > > print(mlb.classes_) > > > > I am getting - > > > > image > > > > Whereas, the output (sample output) I want is - > > > > image > > > > I got the above output by - > > > > mlb = MultiLabelBinarizer() > > sample_labels = [ > > ['stat.ML', 'cs.LG'], > > ['cs.CV', 'cs.RO'] > > ] > > mlb.fit(sample_labels) > > print(mlb.classes_) > > > > Help would be very much appreciated here. > > > > Here's the dataset I had prepared: > > arXivdata.csv.zip > > > > I stripped away the double quotes in the labels after loading it in a > pandas DataFrame by - > > > > import re > > > > arxiv_data['labels'] = arxiv_data['labels'].str.replace(r"[\"]", '') > > > > scikit-learn version: '0.21.3' > > > > Sayak Paul | sayak.dev > > > > ------------------------------ > > Message: 2 > Date: Thu, 12 Sep 2019 10:06:30 +0200 > From: Guillaume Lema?tre <g.lemaitre58(a)gmail.com> > To: Scikit-learn mailing list <scikit-learn(a)python.org> > Subject: Re: [scikit-learn] Vote on SLEP009: keyword only arguments > Message-ID: > < > CACDxx9jCkE5GAjRNj3TKinbuyWZQvXMrrcHBBqn6q_FXYdPrbQ(a)mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > To the question: do we want to utilise Python 3's force-keyword-argument > syntax > and to change existing APIs which support arguments positionally to use > this > syntax, via a deprecation period? > > I am +1. > > IMO, even if the syntax might be unknown, it will remain unknown until > projects > from the ecosystem are not using it. > > To the question: which methods should be impacted? > > I think we should be as gentle as possible at first. I am a little > concerned about > breaking some codes which were working fine before. > > On Thu, 12 Sep 2019 at 04:43, Joel Nothman <joel.nothman(a)gmail.com> wrote: > > > These there details of specific API changes to be decided: > > > > The question being put, as per the SLEP, is: > > do we want to utilise Python 3's force-keyword-argument syntax > > and to change existing APIs which support arguments positionally to use > > this syntax, via a deprecation period? > > _______________________________________________ > > scikit-learn mailing list > > scikit-learn(a)python.org > > https://mail.python.org/mailman/listinfo/scikit-learn > > > > > -- > Guillaume Lemaitre > INRIA Saclay - Parietal team > Center for Data Science Paris-Saclay > https://glemaitre.github.io/ >

1 0

How can I enable line tracing for cython modules.
by Alejandro Javier Peralta Frias Sept. 12, 2019

Sept. 12, 2019

Hello all, To enable cython tracing (in particular I want to line trace neighbors module) I understand that I have to recompile the cython modules with CYTHON_TRACE=1 but I'm not sure where should I set this. Should I use: # distutils: define_macros=CYTHON_TRACE_NOGIL=1 In the files I want to trace? Regards, -- Ale

1 0

MultiLabelBinarizer gives individual characters instead of the classes
by Sayak Paul Sept. 12, 2019

Sept. 12, 2019

Hi. I am working on a Multi-label text classification problem. In order to encode the labels, I am using MultiLabelBinarizer. The labels of the dataset look like - [image: image] <https://user-images.githubusercontent.com/22957388/64753547-42b10a00-d541-1…> When I am using mlb = MultiLabelBinarizer() mlb.fit(labels)print(mlb.classes_) I am getting - [image: image] <https://user-images.githubusercontent.com/22957388/64753625-78ee8980-d541-1…> Whereas, the output (sample output) I want is - [image: image] <https://user-images.githubusercontent.com/22957388/64753641-89066900-d541-1…> I got the above output by - mlb = MultiLabelBinarizer() sample_labels = [ ['stat.ML', 'cs.LG'], ['cs.CV', 'cs.RO'] ] mlb.fit(sample_labels)print(mlb.classes_) Help would be very much appreciated here. Here's the dataset I had prepared: arXivdata.csv.zip <https://github.com/scikit-learn/scikit-learn/files/3603687/arXivdata.csv.zip> I stripped away the double quotes in the labels after loading it in a pandas DataFrame by - import re arxiv_data['labels'] = arxiv_data['labels'].str.replace(r"[\"]", '') scikit-learn version: '0.21.3' Sayak Paul | sayak.dev

2 1

Incremental learning in scikit-learn
by Farzana Anowar Sept. 10, 2019

Sept. 10, 2019

Hello Sir/Madam, I am going through the incremental learning algorithm in Scikit-learn. SGD in sci-kit learn is such a kind of algorithm that allows learning incrementally by passing chunks/batches. Now my question is: does sci-kit learn keeps all the batches for training data in memory? Or it keeps chunks/batches in memory up to a certain amount of size? Or it keeps only one chunk/batch while training in memory and removes the other trained chunks/batches after training? Does that mean it suffers from catastrophic forgetting? Thanks! -- Regards, Farzana Anowar

2 2

Questions about partial_fit and the Incremental library in Sci-kit learn
by Farzana Anowar Sept. 9, 2019

Sept. 9, 2019

Hello Sir/Madam, I subscribed to the link you sent me. I am posting my question again: This Is Farzana Anowar, a Ph.D. candidate in University of Regina. Currently, I'm working to develop a model that learns incrementally from non-stationary data. I have come across an Incremental library in sci-kit learn that actually allows to do that using partial_fit. I have searched a lot for the detailed information about this 'incremental' library and 'partial_fit', however, I couldn't find any. It would be great if you could provide me with some detailed information about these two regarding how they actually work. For example, If we take SGD as a classifier, the incremental library will allow me to take chunks/batches of data. My question is: Do this incremental library train (using parial_fit) the whole batch at a time and then produce a classification performance or it takes a batch and trains each instance at a time from the batch. Thanks in advance! -- Regards, Farzana Anowar

2 4

scikit-learn website and documentation
by Chiara Marmo Sept. 9, 2019

Sept. 9, 2019

Dear list, dear devs, I have started to look at the scikit-learn documentation: talking with developers in July here in Paris, it seemed that you all are concerned by a reorganization / relooking of the doc and nothing is better than a naïve beginner to check the effectiveness of a doc ... right? ;) ... and diving into the docs allows me to better familiarize with the project... :) As CSS and HTML5 are a bit more fun than reStructuredText I've started to play with styling together with the sphinx contents ... contents ask for more focusing ... I will be more serious on that starting from September ... >From the styling point of view, I am a big fan of this one [1] that you probably already know and I tried to apply those amazing styles to sphinx documentation. Then I saw the Andreas tweet [2] ... and decided to stop by to sum up. I've prepared a mock-up for the webpage available here [3]. It's a standard build of the doc with the editorial [4] styling (basic customization needs improvements). The code is available here [5]. I've tried not to move too far from the original visual ... because history is important, especially when you have one! :) I've focused on the homepage so don't expect big modifications in the doc itself. This is just a proof of concept. If you think I'm on the right track let me know... I will be happy to be useful on that. If not, or you already have someone taking care of that, please let me know too and I will find something else to do. Thanks for reading me. Best, Chiara [1] https://html5up.net/ [2] https://twitter.com/amuellerml/status/1161298913841885184 [3] https://cmarmo.github.io/mockup-skl/ [4] https://html5up.net/editorial [5] https://github.com/cmarmo/scikit-learn

6 10

Outreachy program
by Adrin Sept. 9, 2019

Sept. 9, 2019

Hi, During EuroScipy, we had a few discussions regarding diversity in open source in general, and one of the ways some projects have tried to improve that has been through participation in the Outreachy program (https://www.outreachy.org/). I'd be happy to mentor somebody if they apply. Would that be okay if we apply? The deadline has just passed, but if they're flexible, we may be able to still apply. Thanks, Adrin.

2 1

Clustering Algorithm based on correlation distance
by Safi Ullah Marwat Sept. 4, 2019

Sept. 4, 2019

Dear List, Is there any clustering algorithm, which is based on correlation coefficient instead of Euclidean/Manhattan distance? Regards

3 3

WiMLDS scikit-learn sprints
by Reshama Shaikh Sept. 4, 2019

Sept. 4, 2019

Hello, I'm currently working on organizing the 3rd WiMLDS scikit-learn sprint for 2019, this last one is in San Francisco (SF). Someone suggested it would be a good idea to share information about those sprints with this community. Repo for latest sprint in NYC: https://github.com/WiMLDS/nyc-2019-scikit-sprint Website for upcoming sprint in SF: https://sites.google.com/view/bay-area-wimlds-2019-sprint/home RELATED ARTICLES * [About WiMLDS open source sprints](http://wimlds.org/opensourcesprints-2/) (Reshama Shaikh) * [Nairobi WiMLDS 2019 Sprint Impact Report]( https://reshamas.github.io/nairobi-wimlds-2019-scikit-learn-sprint-impact-r…) (Reshama Shaikh) * [Scikit-learn Sprint at Nairobi, Kenya]( https://adrin.info/scikit-learn-sprint-at-nairobi-kenya.html) (Adrin Jalali) * [Highlights from the 2019 Nairobi WiMLDS Scikit-learn Sprint]( https://medium.com/@mariamhaji01/highlights-from-the-2019-nairobi-wimlds-sc…) (Mariam Haji) * [NYC WiMLDS: 2017-2018 Sprint Impact Report]( https://reshamas.github.io/impact-report-for-wimlds-scikit-learn-sprints/) (Reshama Shaikh) * [Highlights from 2018 WiMLDS NYC / Scikit Sprint]( https://reshamas.github.io/highlights-from-the-2018-NYC-WiMLDS-scikit-sprin…) (Reshama Shaikh) * [Interview with Andreas Mueller, Core Contributor to Scikit-Learn]( http://mlconf.com/interview-andreas-muller-lecturer-columbia-university-cor…) (Reshama Shaikh) Best, Reshama --------------------------------------- Reshama Shaikh Blog <https://reshamas.github.io/> | Twitter <https://twitter.com/reshamas> | LinkedIn <https://www.linkedin.com/in/reshamas/> | Instagram <https://www.instagram.com/reshama.sh/> | GitHub <https://github.com/reshamas> NYC WiMLDS Co-organizer WiMLDS Board Member NYC WiMLDS <https://meet.meetup.com/wf/click?upn=XTL-2BADyqX-2FD82kkVyMmL1UTawfruRN9Xsi…> NYC PyLadies <https://meet.meetup.com/wf/click?upn=pEEcc35imY7Cq0tG1vyTt6zEs68RbcMfjPcajN…> ---------------------------------------

1 0

Re: [scikit-learn] scikit-learn Digest, Vol 41, Issue 21
by Mike Smith Sept. 3, 2019

Sept. 3, 2019

Hi, I have been scouring around everywhere to volunteer. I took a one month python course from a training company that promised me a job in two months but they're still working on it after 3. So I decide to volunteer. I'm looking to use python with DS, ML, AI, etc, I love neural nets, then it hit me that I get the scikit mailing list and opened it up and you guys are talking about volunteers. I would love to volunteer for scikit. But I just have one month training in python. I have prior experience with java and javascript, some computer science education, How can I start volunteering? On Mon, Aug 26, 2019 at 9:03 AM <scikit-learn-request(a)python.org> wrote: > Send scikit-learn mailing list submissions to > scikit-learn(a)python.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://mail.python.org/mailman/listinfo/scikit-learn > or, via email, send a message with subject or body 'help' to > scikit-learn-request(a)python.org > > You can reach the person managing the list at > scikit-learn-owner(a)python.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of scikit-learn digest..." > > > Today's Topics: > > 1. Re: Monthly meetings between core developers + "Hello World" > (Nicolas Hug) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Mon, 26 Aug 2019 08:54:21 -0400 > From: Nicolas Hug <niourf(a)gmail.com> > To: scikit-learn(a)python.org > Subject: Re: [scikit-learn] Monthly meetings between core developers + > "Hello World" > Message-ID: <136faf1a-5514-1c21-7514-0673b4ddde81(a)gmail.com> > Content-Type: text/plain; charset="utf-8"; Format="flowed" > > Meeting is in 5 minutes everyone! Prepare to be np.random.choice'd? :) > > https://appear.in/amueller > < > https://www.google.com/url?q=https://appear.in/amueller&sa=D&ust=1566914386… > > > > > On 8/22/19 10:11 AM, Nicolas Hug wrote: > > > > Hi Everyone, > > > > Quick reminder that the next meeting is on Monday! *Please update your > > cards on the project board* so we can all have a look before the > week-end. > > > > We decided to go for a "scrum-like" approach this time: quickly go > > through everyone's notes first, then discuss main issues. > > > > Anyone interested in hosting? I think we should have a new person each > > time, or you'll soon be fed up with me. If nobody speaks up I'll > > np.random.choice someone on Monday ;) > > > > ---- > > > > Time and date: > > > https://www.timeanddate.com/worldclock/meetingdetails.html?year=2019&month=… > > > > Project board: > > https://github.com/scikit-learn/scikit-learn/projects/15 > > < > https://www.google.com/url?q=https://github.com/scikit-learn/scikit-learn/p… > > > > > > Meeting link: https://appear.in/amueller > > < > https://www.google.com/url?q=https://appear.in/amueller&sa=D&ust=1566914386… > > > > > > > > See you on Monday! > > > > Nicolas > > > > > > On 8/5/19 10:31 AM, Andreas Mueller wrote: > >> As usual, I agree ;) > >> I think it would be good to call out particularly important bugfixes > >> so they get reviews. > >> We might also want to think about how we can organize the issue > >> tracker better. > >> > >> Having more full-time people on the project certainly means more > >> activity but ideally we can use some of that time to make the issue > >> tracker more organized. > >> > >> > >> On 8/5/19 9:21 AM, Joel Nothman wrote: > >>> Yay for technology!?Awesome to see you all and have some matters > >>> clarified. > >>> > >>> Adrin is right that the issue tracker is increasingly overwhelming > >>> (because there are more awesome people hired to work on the project, > >>> more frequent sprints, etc). This meeting is a useful summary. > >>> > >>> The meeting mostly focussed on big features. We should be careful to > >>> not leave behind important bugs fixes and work originating outside > >>> the core devs. > >>> > >>> Despite that: Some of Guillaume's activities got cut off. I think it > >>> would be great to progress both on stacking and resampling before > >>> the next release. > >>> > >>> I also think these meetings should, as a standing item, note the > >>> estimated upcoming release schedule, to help us remain aware of that > >>> cadence. > >>> > >>> Good night! > >>> > >>> J > >>> > >>> _______________________________________________ > >>> scikit-learn mailing list > >>> scikit-learn(a)python.org > >>> https://mail.python.org/mailman/listinfo/scikit-learn > >> > >> > >> _______________________________________________ > >> scikit-learn mailing list > >> scikit-learn(a)python.org > >> https://mail.python.org/mailman/listinfo/scikit-learn >

2 1