🌐 Mailman 3 May 2017 - scikit-learn - python.org

How can I tell if I am getting the loading values from a PCA analysis using scikit-learn?
by David Schlessinger May 4, 2017

May 4, 2017

Firstly, I apologize in advance if the following questions I have are very basic. I am very new to coding in general, as well as Principal Component Analysis and scikit-learn. I am trying to finish a project for an internship and hit a wall, and am desperately trying to seek help to solve this before my deadline. I have a set of RNA sequences that are evaluated based on several parameters. For the sake of simplicity, let's say there are three parameters: the GC content in the RNA sequence's ribosome binding site (RBS), the estimated stability of the RNA sequences' secondary structures (MFE), and the ensemble defect of the RNA (i.e. the number of nucleotides that do not conform to a prescribed secondary structure). A series of functions calculated the values of these RNA sequences for each parameter, and the lower their calculated value is, the more indicative it is that the RNA sequence in question is more optimal for our experimental purposes. What I am now trying to do is build a composite score from the values in these parameters for each RNA sequence using PCA. Rather than use PCA for dimension reduction, I am going to use it to determine the loading values for each value to their respective component. I have been using the following code to calculate the loadings and subsequently utilize them for the creation of a composite score, which is the sum of the original values multiplied by their corresponding loading values (i.e. the loading values are used as weights on the original values). import pandas as pd from sklearn.decomposition import PCA from sklearn.preprocessing import scale green= path.join(output_folder, "SequenceScoring.csv") df = pd.read_csv(green) X= df.values X = scale(X) pca = PCA(n_components=3) pca.fit(X) X1=pca.fit_transform(X) df1 = pd.DataFrame(data= X1, index= range(len(df['MFE of Sequence Complex'])), columns= ['Loading MFE of Sequence Complex', 'Loading Percentage of Ensemble Defect of RBS of Trigger-Switch Complex', 'Loading GC Content of RBS Region in Switch']) Although this seems to be the correct procedure, I am not certain if I properly understand the output of X1=pca.fit_transform(X). One source I initially used ostensibly cleared the matter (source: Sklearn PCA is pca.components_ the loadings?<https://stackoverflow.com/questions/36380183/sklearn-pca-is-pca-components-…>), but upon closer inspection, I realized I wasn't sure if I was getting the correct values, which was described as "the result of the projection for each sample into the vector space spanned by the components". Furthermore, loadings can also be defined as being "sums of squares within each component are the eigenvalues (components' variances)" (source: https://stats.stackexchange.com/questions/92499/how-to-interpret-pca-loadin…). I checked the Eigenvalues of my parameters using: X_std = StandardScaler().fit_transform(X) cov_mat = np.cov(X_std.T) eig_vals, eig_vecs = np.linalg.eig(cov_mat) print('\nEigenvalues \n%s' %eig_vals) And then I squared and summed the loading values in each column produced by 'X1=pca.fit_transform(X)`, and found that they did not match the Eigenvalues for the respective parameters at all. It is worth noting that I understood the term "loading values" as the distance between a certain value and an associated component (so that values that influenced the slope and variance captured by the component more strongly had higher loading values). Am I fundamentally misunderstanding the concept of loading values? Or am I not using the right function from scikit-learn? I have tried to look through the source code for scikit-learn's pca.fit_transform, but I don't have the level of mathematical or coding experience required to understand it. Thanks so much, David

1 0

question about scikit-learn
by 熊瑶 May 3, 2017

May 3, 2017

Dear professor, scikit-learn is really good for me to do some work using machine learning method. Here, I have two questions: 1）To do 5 fold cross-validation, when I use StratifiedKFold，I could get stratified folds that each fold contains approximately the same percentage of samples of each target class as the complete set. And, when I use GroupKFold, it ensures that the same group is not represented in both testing and training sets. I want to know whether there is a method to combine these two methods together? 2) When I use GridSearchCV to do parameter search, I use scoring="accuracy" as scoring function to choose the best parameters. And I find that I can only get the accuracy score from the 5 fold cross-validation. What can I do if I want to get other scores such as sensitivity, specificity, MCC at the same time? It means that I want to use accuracy to choose the best parameters and I want to get the scores of many scoring parameters at the same time when I do 5 fold cross-validation. Thank you. 熊瑶北京大学深圳研究生院化学生物学与生物技术学院 XIONG Yao G301, School of Chemical Biology & Biotechnology Peking University Shenzhen Graduate School Shenzhen 518055, Guangdong, P.R. China E-mail: xiongyao(a)pku.edu.cn or xiongy20121126(a)foxmail.com

1 0

gridsearchCV able to handle list of input?
by Carlton Banks May 1, 2017

May 1, 2017

I am currently trying to run some gridsearchCV on a keras model which has multiple inputs. The inputs is stored in a list in which each entry in the list is a input for a specific channel. Here is my model and how i use the gridsearch. https://pastebin.com/GMKH1L80 <https://pastebin.com/GMKH1L80> The error i am getting is: https://pastebin.com/A3cB0rMv <https://pastebin.com/A3cB0rMv> Any idea how i can resolve this?

3 13