You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-13 - 11:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot8s.osadl.org (updated Sat Dec 13, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31797519912320,1228cyclictest35507642sleep300:05:013
31797519911601,1156cyclictest33004162sleep320:44:563
3179751999850,982cyclictest3413266-21sleep22:15:013
3179751993810,369cyclictest3463155-21turbostat22:59:563
3179751993550,351cyclictest3179650-21turbostat19:14:553
3179751991815,1cyclictest0-21swapper/320:45:123
317975199171,12cyclictest3544335-21taskset00:00:003
317975199171,12cyclictest3443398-21taskset22:35:183
317975199166,8cyclictest3238114-21turbostat19:59:563
317975199165,8cyclictest3287968-21turbostat20:35:003
3179751991613,1cyclictest0-21swapper/321:40:223
317975199161,12cyclictest3331912-21taskset21:09:573
3179751991513,1cyclictest0-21swapper/323:30:363
3179751991513,1cyclictest0-21swapper/323:23:313
3179751991513,1cyclictest0-21swapper/322:29:013
3179751991513,1cyclictest0-21swapper/320:50:143
3179751991513,0cyclictest0-21swapper/323:49:593
3179751991512,1cyclictest0-21swapper/321:50:013
3179751991512,1cyclictest0-21swapper/320:01:183
317975199151,11cyclictest3494326-21turbostat23:20:003
317975199151,11cyclictest3346144-21taskset21:20:143
317975199151,11cyclictest3200399-21taskset19:24:563
317975199151,10cyclictest3281151-21taskset20:25:223
317975199141,9cyclictest3450963-21taskset22:45:083
317975199141,9cyclictest32196282sleep319:40:113
3179751991413,0cyclictest0-21swapper/320:57:193
3179751991413,0cyclictest0-21swapper/300:39:183
3179751991412,1cyclictest0-21swapper/323:00:073
3179751991412,1cyclictest0-21swapper/319:52:073
3179751991412,1cyclictest0-21swapper/319:52:073
3179751991411,1cyclictest0-21swapper/323:50:173
3179751991411,1cyclictest0-21swapper/323:05:473
3179751991411,1cyclictest0-21swapper/322:05:173
3179751991411,1cyclictest0-21swapper/320:36:383
3179751991411,1cyclictest0-21swapper/320:17:143
3179751991411,1cyclictest0-21swapper/320:05:533
317975199141,10cyclictest3460587-21taskset22:50:123
317975199141,10cyclictest3363557-21taskset21:35:123
317975199141,10cyclictest3343867-21taskset21:15:223
317975199141,10cyclictest3319692-21taskset21:00:113
317975199135,6cyclictest3363008-21taskset21:33:453
317975199131,9cyclictest3577725-21taskset00:25:123
317975199131,9cyclictest3568532-21taskset00:15:153
317975199131,9cyclictest3544580-21taskset00:00:083
317975199131,9cyclictest3487735-21taskset23:10:253
317975199131,9cyclictest3257072-21taskset20:10:043
317975199131,8cyclictest34447122sleep322:40:093
3179751991312,0cyclictest0-21swapper/323:42:153
3179751991312,0cyclictest0-21swapper/322:21:023
3179751991312,0cyclictest0-21swapper/322:21:013
3179751991311,1cyclictest0-21swapper/323:37:323
3179751991311,1cyclictest0-21swapper/322:00:133
3179751991311,1cyclictest0-21swapper/319:16:203
317975199131,10cyclictest3356818-21taskset21:29:313
317975199131,10cyclictest3337405-21taskset21:10:203
3179751991311,0cyclictest0-21swapper/320:22:433
3179751991310,1cyclictest0-21swapper/323:25:463
3179751991310,1cyclictest0-21swapper/319:45:233
317975199130,10cyclictest3206082-21chrt19:25:193
34949782120,1sleep13495448-21irqcore23:20:161
34784832124,2sleep2431ktimers/223:05:152
32383532120,3sleep03238386-21apt-get19:55:100
317975199124,6cyclictest3574950-21taskset00:20:193
317975199121,9cyclictest3587837-21chrt00:30:263
3179751991210,1cyclictest0-21swapper/322:15:223
3179751991210,1cyclictest0-21swapper/322:15:223
3179751991210,1cyclictest0-21swapper/319:35:303
317975199120,9cyclictest3560628-21chrt00:10:133
317975199120,9cyclictest3432219-21taskset22:30:063
317975199120,9cyclictest3382057-21taskset21:50:033
317975199120,5cyclictest0-21swapper/319:30:173
31796152120,7sleep13179676-21munin-run19:10:001
301798120,4rtkit-daemon636-21snmpd22:00:021
35507732110,2sleep20-21swapper/200:05:092
35257792111,2sleep00-21swapper/023:45:070
34825102111,2sleep20-21swapper/223:10:132
33633732111,6sleep13363395-21apt-get21:35:121
32198812110,5sleep23220080-21if_eno119:40:142
31799592110,8sleep03180108-21df_inode19:10:120
317975199110,9cyclictest3394281-21taskset21:59:523
35310032100,7sleep23531135-21sed23:45:172
34655442104,3sleep23467727-21kthreadcore22:55:142
33004202101,6sleep23300443-21turbostat20:45:012
32006522101,6sleep03200746-21dpkg19:25:020
301798100,6rtkit-daemon317-21systemd-udevd22:09:331
3544544291,4sleep23544577-21apt-get00:00:082
3525815290,2sleep13525959-21df23:45:081
3450927292,4sleep23450960-21apt-get22:45:092
3313410290,4sleep23312947-21apt-get20:55:022
3218319291,5sleep03218480-21ntpq19:35:190
30179890,6rtkit-daemon492-21gmain20:04:051
30179890,5rtkit-daemon3425991-21/usr/sbin/munin22:25:101
30179890,5rtkit-daemon3414054-21irqcore22:15:121
30179890,5rtkit-daemon3414054-21irqcore22:15:111
30179890,5rtkit-daemon3362420-21python321:30:211
30179890,5rtkit-daemon3207664-21ps19:30:151
30179890,5rtkit-daemon317-21systemd-udevd22:31:341
30179890,4rtkit-daemon3552241-21uname00:05:141
30179890,4rtkit-daemon3534177-21cat23:50:131
30179890,4rtkit-daemon3388324-21apt-get21:55:081
30179890,3rtkit-daemon636-21snmpd22:47:411
30179890,3rtkit-daemon492-21gmain00:37:281
30179890,1rtkit-daemon0-21swapper/119:40:391
3581788280,2sleep23581789-21sshd00:28:042
3543338281,5sleep23543397-21ntp_states23:55:152
3533051280,5sleep03534350-21kthreadcore23:50:120
3515795280,6sleep03518012-21cut23:35:180
3499862280,5sleep03500074-21grep23:20:230
3380899281,4sleep03380969-21ntp_states21:45:200
3369612281,3sleep03369645-21apt-get21:40:110
3350905281,3sleep03350940-21apt-get21:25:130
3337528281,4sleep03337794-21grep21:10:220
3331229281,4sleep13331440-21grep21:05:231
3290025281,4sleep03292152-21kthreadcore20:35:170
3262424280,5sleep03262550-21smartctl20:12:250
3240978281,5sleep23243198-21cut19:55:172
3194867281,4sleep23195077-21cut19:20:152
30179880,5rtkit-daemon430-21avahi-daemon22:50:011
30179880,5rtkit-daemon430-21avahi-daemon21:45:061
30179880,5rtkit-daemon317-21systemd-udevd21:29:331
30179880,4rtkit-daemon667-21lldpd00:30:521
30179880,4rtkit-daemon638-21ntpd23:34:071
30179880,4rtkit-daemon638-21ntpd00:18:481
30179880,4rtkit-daemon636-21snmpd23:55:351
30179880,4rtkit-daemon636-21snmpd23:45:001
30179880,4rtkit-daemon636-21snmpd22:20:021
30179880,4rtkit-daemon636-21snmpd22:20:011
30179880,4rtkit-daemon636-21snmpd21:42:241
30179880,4rtkit-daemon636-21snmpd20:50:461
30179880,4rtkit-daemon636-21snmpd20:45:021
30179880,4rtkit-daemon636-21snmpd20:23:591
30179880,4rtkit-daemon636-21snmpd20:15:531
30179880,4rtkit-daemon636-21snmpd00:11:481
30179880,4rtkit-daemon492-21gmain19:26:491
30179880,4rtkit-daemon448-21wpa_supplicant22:42:561
30179880,4rtkit-daemon448-21wpa_supplicant21:01:411
30179880,4rtkit-daemon430-21avahi-daemon21:51:261
30179880,4rtkit-daemon3226354-21interrupts19:45:151
30179880,4rtkit-daemon3205-21sendmail-mta20:36:421
30179880,4rtkit-daemon3205-21sendmail-mta19:38:451
30179880,4rtkit-daemon3186086-21munin-node22:10:331
30179880,4rtkit-daemon3186086-21munin-node20:55:091
30179880,4rtkit-daemon3186086-21munin-node19:21:501
30179880,4rtkit-daemon297-21systemd-journal23:35:161
30179880,4rtkit-daemon297-21systemd-journal00:20:171
30179880,4rtkit-daemon2904-21cron22:58:591
30179880,3rtkit-daemon448-21wpa_supplicant20:14:101
30179880,3rtkit-daemon3469670-21apt-get23:00:121
3500837270,4sleep03500901-21ls23:25:130
3488339270,3sleep13488372-21apt-get23:15:071
3388329271,1sleep014-21ksoftirqd/021:55:090
3340165271,3sleep13342317-21grep21:15:161
3332174270,3sleep13332207-21apt-get21:10:111
3279416270,4sleep23280704-21memory20:25:182
3276299270,5sleep03277303-21kthreadcore20:25:160
3238097270,1sleep20-21swapper/219:55:012
3238097270,1sleep20-21swapper/219:55:002
3207173270,3sleep23207206-21apt-get19:30:122
3194510270,4sleep03194666-21diskstats19:20:120
3185957271,3sleep13186429-21irqstats19:15:011
3175705270,4sleep30-21swapper/319:05:143
3174715270,4sleep23175704-21kthreadcore19:05:122
30179870,4rtkit-daemon636-21snmpd22:37:301
30179870,4rtkit-daemon3200908-21packagekitd21:21:031
30179870,4rtkit-daemon3186086-21munin-node00:00:251
30179870,3rtkit-daemon638-21ntpd20:30:581
30179870,3rtkit-daemon638-21ntpd19:10:511
30179870,3rtkit-daemon636-21snmpd20:48:231
30179870,3rtkit-daemon492-21gmain23:07:241
30179870,3rtkit-daemon3576130-21diskstats00:25:091
30179870,3rtkit-daemon3238602-21tune2fs19:55:121
30179870,3rtkit-daemon3205-21sendmail-mta20:05:541
30179870,3rtkit-daemon3186086-21munin-node23:11:431
30179870,3rtkit-daemon3186086-21munin-node20:26:441
30179870,3rtkit-daemon3186086-21munin-node19:50:311
30179870,3rtkit-daemon3186086-21munin-node19:50:301
3587695262,1sleep00-21swapper/000:30:190
3583683260,4sleep23585678-21tr00:30:142
3571166261,2sleep20-21swapper/200:20:162
3569387260,1sleep00-21swapper/000:19:250
3569092261,3sleep2636-21snmpd00:15:422
3556543260,1sleep00-21swapper/000:07:200
3550463260,1sleep00-21swapper/000:04:140
3512837260,3sleep03512838-21sshd23:32:130
3502577261,3sleep13504707-21cut23:25:181
3494612261,3sleep23494756-21df23:20:132
3476298260,3sleep03477163-21sed23:05:130
3438955260,4sleep03439956-21sort22:35:160
3432227261,2sleep03432259-21apt-get22:30:120
3431889260,1sleep00-21swapper/022:28:590
3419769261,2sleep23419802-21apt-get22:20:132
3419769261,2sleep23419802-21apt-get22:20:122
3408713260,4sleep00-21swapper/022:10:120
3406654260,1sleep00-21swapper/022:08:480
3394565260,3sleep23394598-21apt-get22:00:092
3388688261,3sleep20-21swapper/221:55:112
3360837260,3sleep03362077-21memory21:30:170
3357684261,3sleep23358733-21cat21:30:162
3333631261,2sleep20-21swapper/221:10:162
3330947260,3sleep23331052-21ntpq21:05:202
3324351260,3sleep23324704-21tr21:00:192
3320914260,3sleep03322138-21cut21:00:170
3295920260,4sleep03297801-21kthreadcore20:40:180
3263367260,3sleep23263511-21df20:15:112
3186430261,2sleep23187574-21kthreadcore19:15:022
3173920260,2sleep00-21swapper/019:05:100
3576132250,3sleep03576316-21gltestperf00:25:100
3543975250,3sleep00-21swapper/023:56:340
3525400250,1sleep00-21swapper/023:43:200
3494208250,1sleep00-21swapper/023:18:520
3482152250,3sleep03482308-21diskstats23:10:110
3462907250,1sleep00-21swapper/022:52:070
3458669250,3sleep23460586-21grep22:50:122
3444698250,1sleep00-21swapper/022:40:050
3421517250,3sleep03404976-21kworker/0:1+events22:20:190
3421517250,3sleep03404976-21kworker/0:1+events22:20:180
3414947250,2sleep00-21swapper/022:15:140
3414947250,2sleep00-21swapper/022:15:130
3406455250,1sleep20-21swapper/222:06:132
3400441250,1sleep00-21swapper/022:03:440
3387902250,1sleep00-21swapper/021:53:140
3387749250,1sleep20-21swapper/221:51:152
3375827250,1sleep20-21swapper/221:45:032
3368751250,3sleep03368968-21/usr/sbin/munin21:35:230
3353215250,3sleep23355415-21grep21:25:192
3344199250,1sleep00-21swapper/021:17:230
3343703251,2sleep20-21swapper/221:15:212
3328347251,2sleep00-21swapper/021:05:180
3307109250,3sleep03307154-21fschecks_count20:50:110
3306925251,1sleep20-21swapper/220:50:102
3306416250,1sleep20-21swapper/220:46:402
3302133251,2sleep03300673-21/usr/sbin/munin20:45:140
3283452250,2sleep00-21swapper/020:30:160
3270032251,1sleep00-21swapper/020:20:140
3269242250,3sleep00-21swapper/020:19:110
3253402251,2sleep00-21swapper/020:05:160
3237893250,1sleep00-21swapper/019:52:230
3237893250,1sleep00-21swapper/019:52:220
3231773250,1sleep20-21swapper/219:48:432
3227217251,2sleep00-21swapper/019:45:170
3210211250,2sleep03212063-21cat19:30:180
3194004250,1sleep00-21swapper/019:17:320
3185887250,1sleep20-21swapper/219:14:192
3536554240,2sleep23537059-21strings23:50:152
3524631240,2sleep23524694-21ntp_states23:40:202
3519212240,3sleep20-21swapper/223:39:092
3511977240,2sleep23512147-21awk23:30:152
3493968240,3sleep20-21swapper/223:15:482
3474600241,1sleep20-21swapper/223:00:182
3456111240,2sleep03456237-21smartctl22:45:190
3426996240,2sleep20-21swapper/222:25:122
3407257240,3sleep20-21swapper/222:10:072
3344675240,1sleep20-21swapper/221:20:112
3319415240,1sleep00-21swapper/021:00:020
3288596240,2sleep20-21swapper/220:35:152
3275467240,1sleep20-21swapper/220:23:532
3262884240,3sleep20-21swapper/220:12:322
3251272240,2sleep20-21swapper/220:05:142
3215337240,2sleep20-21swapper/219:35:182
3200932240,1sleep20-21swapper/219:25:112
3588453230,1sleep20-21swapper/200:35:132
3588439230,1sleep00-21swapper/000:35:040
3574611230,1sleep00-21swapper/000:20:180
3558527230,1sleep20-21swapper/200:10:132
3557310230,1sleep00-21swapper/000:10:110
3500996230,1sleep20-21swapper/223:25:152
3471098230,1sleep00-21swapper/023:00:170
3463382230,1sleep00-21swapper/022:55:070
3445097230,1sleep20-21swapper/222:40:112
3438651230,1sleep20-21swapper/222:35:142
3432420230,1sleep20-21swapper/222:30:142
3419371230,2sleep20-21swapper/222:18:272
3419371230,2sleep20-21swapper/222:18:272
3372084230,1sleep20-21swapper/221:40:172
3365024230,1sleep20-21swapper/221:35:162
3344868230,1sleep00-21swapper/021:20:130
3287589230,1sleep20-21swapper/220:30:262
3250513230,1sleep00-21swapper/020:04:130
3244352230,1sleep20-21swapper/220:00:012
3219665230,1sleep00-21swapper/019:40:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional