Calificación:
  • 14 voto(s) - 3.14 Media
  • 1
  • 2
  • 3
  • 4
  • 5

Trasfermkt Scraper for PCF working Beta
#16

(07-01-2020, 10:07 PM)Mikimelo escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.Hi. First of all, thank you very much, this looks amazing. I was watching the video and reading yoyr posts and i would like to ask you If the "media" value that the script asigns (that I guess it's done based on the table used for pcf revolution) can be modified. For my edition I use a different table to asign the Media based on Transfermarkt values.

Thanks!
modify this part using your value and send me
Código:
                   if int(market_value) < 25000:
                       media = 45
                   elif int(market_value) < 50000:
                       media = 46
                   elif int(market_value) < 75000:
                       media = 47
                   elif int(market_value) < 100000:
                       media = 48
                   elif int(market_value) < 120000:
                       media = 49
                   elif int(market_value) < 150000:
                       media = 50
                   elif int(market_value) < 200000:
                       media = 51
                   elif int(market_value) < 300000:
                       media = 52
                   elif int(market_value) < 400000:
                       media = 53
                   elif int(market_value) < 500000:
                       media = 54
                   elif int(market_value) < 600000:
                       media = 55
                   elif int(market_value) < 700000:
                       media = 56
                   elif int(market_value) < 800000:
                       media = 57
                   elif int(market_value) < 900000:
                       media = 58
                   elif int(market_value) < 1000000:
                       media = 59
                   elif int(market_value) < 1500000:
                       media = 60
                   elif int(market_value) < 2000000:
                       media = 61
                   elif int(market_value) < 3000000:
                       media = 62
                   elif int(market_value) < 4000000:
                       media = 63
                   elif int(market_value) < 5000000:
                       media = 64
                   elif int(market_value) < 6000000:
                       media = 65
                   elif int(market_value) < 7000000:
                       media = 66
                   elif int(market_value) < 8000000:
                       media = 67
                   elif int(market_value) < 9000000:
                       media = 68
                   elif int(market_value) < 10000000:
                       media = 69
                   elif int(market_value) < 12000000:
                       media = 70
                   elif int(market_value) < 15000000:
                       media = 71
                   elif int(market_value) < 20000000:
                       media = 72
                   elif int(market_value) < 22000000:
                       media = 73
                   elif int(market_value) < 25000000:
                       media = 74
                   elif int(market_value) < 28000000:
                       media = 75
                   elif int(market_value) < 30000000:
                       media = 76
                   elif int(market_value) < 35000000:
                       media = 77
                   elif int(market_value) < 40000000:
                       media = 78
                   elif int(market_value) < 50000000:
                       media = 79
                   elif int(market_value) < 55000000:
                       media = 80
                   elif int(market_value) < 60000000:
                       media = 81
                   elif int(market_value) < 70000000:
                       media = 82
                   elif int(market_value) < 80000000:
                       media = 83
                   elif int(market_value) < 90000000:
                       media = 84
                   elif int(market_value) < 100000000:
                       media = 85
                   elif int(market_value) < 125000000:
                       media = 86
                   elif int(market_value) < 150000000:
                       media = 87
                   elif int(market_value) < 175000000:
                       media = 88
                   elif int(market_value) < 200000000:
                       media = 89
                   elif int(market_value) >= 200000000:
                       media = 90
                   else:
                       media = 45
Responder
#17

(09-01-2020, 12:34 AM)and escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.Version 0.3

Modified the engine in order to create xls instead xlsx
fixed one bug
Added Minor Radio Button  (if minor or national team check this radio button)
Better graphic

Hi and, we are slowly approaching the perfect version. Create XLS instead XLSX is very helpful, 'minor' also work very well, but in this last version date of birth appears ##### in the Excel file and today's date in the editor. 'Media' still random for players with a market value higher than 1 million. When your script generate a 'minor', the players have no nationality and passport, and there is always the problem of the date of birth.
Another important aspect I hadn't noticed before, so I can't tell you if it was also present in the first version: for all attacker players that not are centre forward, their main role for your script is Midfielder (for example Dembélé and Messi).
Responder
#18

(09-01-2020, 04:19 PM)olmazabal escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.
(09-01-2020, 12:34 AM)and escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.Version 0.3

Modified the engine in order to create xls instead xlsx
fixed one bug
Added Minor Radio Button  (if minor or national team check this radio button)
Better graphic

Hi and, we are slowly approaching the perfect version. Create XLS instead XLSX is very helpful, 'minor' also work very well, but in this last version date of birth appears ##### in the Excel file and today's date in the editor. 'Media' still random for players with a market value higher than 1 million. When your script generate a 'minor', the players have no nationality and passport, and there is always the problem of the date of birth.
Another important aspect I hadn't noticed before, so I can't tell you if it was also present in the first version: for all attacker players that not are centre forward, their main role for your script is Midfielder (for example Dembélé and Messi).

biggrin.gif  really slowly 

- 'Media' still random for players with a market value higher than 1 million. 

Do you mean that for example if the player has 1.000.001 the media in the editor is random ? or you mean that every player has random media ? 

will be nice if someone of you can show me how to verify and test the result in the editor (now it works for me ) 

* it generate some files once i select and upload the excel 
* how to visualize and verify the content of this file ? what i should do  ?

When your script generate a 'minor', the players have no nationality and passport, and there is always the problem of the date of birth.

Honestly i removed for then  , do you need it ?


for all attacker players that not are centre forward, their main role for your script is Midfielder (for example Dembélé and Messi).

i notice this problem in the previous version , actually i was thinking that it was fixed , but i ll check once again  biggrin.gif
Responder
#19

(09-01-2020, 04:45 PM)and escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.
(09-01-2020, 04:19 PM)olmazabal escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.
(09-01-2020, 12:34 AM)and escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.Version 0.3

Modified the engine in order to create xls instead xlsx
fixed one bug
Added Minor Radio Button  (if minor or national team check this radio button)
Better graphic

Hi and, we are slowly approaching the perfect version. Create XLS instead XLSX is very helpful, 'minor' also work very well, but in this last version date of birth appears ##### in the Excel file and today's date in the editor. 'Media' still random for players with a market value higher than 1 million. When your script generate a 'minor', the players have no nationality and passport, and there is always the problem of the date of birth.
Another important aspect I hadn't noticed before, so I can't tell you if it was also present in the first version: for all attacker players that not are centre forward, their main role for your script is Midfielder (for example Dembélé and Messi).

biggrin.gif  really slowly 

- 'Media' still random for players with a market value higher than 1 million. 

Do you mean that for example if the player has 1.000.001 the media in the editor is random ? or you mean that every player has random media ? 

will be nice if someone of you can show me how to verify and test the result in the editor (now it works for me ) 

* it generate some files once i select and upload the excel 
* how to visualize and verify the content of this file ? what i should do  ?

When your script generate a 'minor', the players have no nationality and passport, and there is always the problem of the date of birth.

Honestly i removed for then  , do you need it ?


for all attacker players that not are centre forward, their main role for your script is Midfielder (for example Dembélé and Messi).

i notice this problem in the previous version , actually i was thinking that it was fixed , but i ll check once again  biggrin.gif

Media: random for the vast majority of players. The difference is even more marked for players with a high value market.
'Minor': not essential, but it would be convenient to include nationality and passport for these players
Date of birth: in your 2nd version you had solved this problem, but now it has come back in this 3rd version
Main and secondary roles: this aspect is essential. There are problems also for secondary roles, especially for defenders.

How to load and view the players in the editor
After running EPCF, you have to click 'Utilidades', then 'Jugadores', then 'Importar Excel'. So you have to write the amount of players contained in the Excel file, then select Excel file. At this point the editor automatically generates the players that you can find inside the folder of the EPCF. If you want to load players in the editor, you have to click 'Crear', then 'Jugador', then 'Importar'.
Responder
#20

Le valutazioni dei giocatori non sono un po 'basse? Preferisco parlare in italiano


FORZA FOGGIA!

Responder
#21

(10-01-2020, 10:08 AM)Fernandiyol escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.Le valutazioni dei giocatori non sono un po 'basse? Preferisco parlare in italiano

Avevo la tua stessa impressione leggendo la tabella che mi e' stata data, ma adesso la trovo una scelta corretta , visto che e' una media di diversi parametri inclusi  parametri che non sempre si addicono ad un giocatore ( un attaccante con parate a 90  )
Responder
#22

Dal tuo punto di vista, tutto sarebbe vederlo. Ciò che è chiaro è che hai creato un ottimo strumento. grande!


FORZA FOGGIA!

Responder
#23

(10-01-2020, 02:31 AM)olmazabal escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.
(09-01-2020, 04:45 PM)and escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.
(09-01-2020, 04:19 PM)olmazabal escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.
(09-01-2020, 12:34 AM)and escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.Version 0.3

Modified the engine in order to create xls instead xlsx
fixed one bug
Added Minor Radio Button  (if minor or national team check this radio button)
Better graphic

Hi and, we are slowly approaching the perfect version. Create XLS instead XLSX is very helpful, 'minor' also work very well, but in this last version date of birth appears ##### in the Excel file and today's date in the editor. 'Media' still random for players with a market value higher than 1 million. When your script generate a 'minor', the players have no nationality and passport, and there is always the problem of the date of birth.
Another important aspect I hadn't noticed before, so I can't tell you if it was also present in the first version: for all attacker players that not are centre forward, their main role for your script is Midfielder (for example Dembélé and Messi).

biggrin.gif  really slowly 

- 'Media' still random for players with a market value higher than 1 million. 

Do you mean that for example if the player has 1.000.001 the media in the editor is random ? or you mean that every player has random media ? 

will be nice if someone of you can show me how to verify and test the result in the editor (now it works for me ) 

* it generate some files once i select and upload the excel 
* how to visualize and verify the content of this file ? what i should do  ?

When your script generate a 'minor', the players have no nationality and passport, and there is always the problem of the date of birth.

Honestly i removed for then  , do you need it ?


for all attacker players that not are centre forward, their main role for your script is Midfielder (for example Dembélé and Messi).

i notice this problem in the previous version , actually i was thinking that it was fixed , but i ll check once again  biggrin.gif

Media: random for the vast majority of players. The difference is even more marked for players with a high value market.

Cita:i ll verify it 



'Minor': not essential, but it would be convenient to include nationality and passport for these players
Cita:Ok 

Date of birth: in your 2nd version you had solved this problem, but now it has come back in this 3rd version
Cita:i changed the engine from 02 to 03 , i ll verify what is the problem 

Main and secondary roles: this aspect is essential. There are problems also for secondary roles, especially for defenders.
Cita:Primary Role is taken directly from the page 
Secondary Role is given randomly between the most common affinity  ( for example  :  Central Defender  -  Libero )


How to load and view the players in the editor
After running EPCF, you have to click 'Utilidades', then 'Jugadores', then 'Importar Excel'. So you have to write the amount of players contained in the Excel file, then select Excel file. At this point the editor automatically generates the players that you can find inside the folder of the EPCF. If you want to load players in the editor, you have to click 'Crear', then 'Jugador', then 'Importar'.
Cita:this will help me a Lot , thank you!
Responder
#24

Good job

Has a lot of potential!
Responder
#25

@and: It is possible to include a function in your script to copy the real (and non-random) secondary roles indicated in transfermarket?
Responder
#26

(10-01-2020, 11:49 PM)olmazabal escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.@and: It is possible to include a function in your script to copy the real (and non-random) secondary roles indicated in transfermarket?

On the first message, i added in the to do list.
Responder
#27

(10-01-2020, 11:49 PM)olmazabal escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.@and: It is possible to include a function in your script to copy the real (and non-random) secondary roles indicated in transfermarket?

Hi Olmazabal


i finally managed to import and use the editor properly , the result is quite good btw 

i took Messi for example  

No puedes ver enlaces como invitado. Regístrate o conectate para verlo.


and seems the Birthday Date is working properly 


No puedes ver enlaces como invitado. Regístrate o conectate para verlo.


The script is now able to scrap the Entrenador automatically

[Imagen: aG3mlH1.png]

EDIT

my script is now taking real secondary roles from each player at next realease will be published spiteful.gif 

[Imagen: lSXB7Kz.png]
Responder
#28

(12-01-2020, 10:45 PM)and escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.
(10-01-2020, 11:49 PM)olmazabal escribió: No puedes ver enlaces como invitado. Regístrate o conectate para verlo.@and: It is possible to include a function in your script to copy the real (and non-random) secondary roles indicated in transfermarket?

Hi Olmazabal


i finally managed to import and use the editor properly , the result is quite good btw 

i took Messi for example  

No puedes ver enlaces como invitado. Regístrate o conectate para verlo.


and seems the Birthday Date is working properly 


No puedes ver enlaces como invitado. Regístrate o conectate para verlo.


The script is now able to scrap the Entrenador automatically

[Imagen: aG3mlH1.png]

EDIT

my script is now taking real secondary roles from each player at next realease will be published spiteful.gif 

[Imagen: lSXB7Kz.png]


Laie_60B.gif Laie_60B.gif Laie_60B.gif
Responder
#29

Ok the script is working fine (live example below)


Every Data is perfect , just 2nd Role and 3rd Role  i notice one problem :

SOME TRANSFMARKT ROLES are not listed here 

[Imagen: 9IfjfLA.png]

the result if the script does not find the role is : Ninguno   (for the example of PERISIC was Mediocentro ofensivo )
[Imagen: k90Q6kf.png]


the live video 



Responder
#30

It could be replaced?

Mediocentro ofensivo = Mediocentro organizador or Mediapunta central

Although is not the same...
Responder


Salto de foro:


Usuarios navegando en este tema: 7 invitado(s)