You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 14:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Sat Mar 14, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32509949912310,1228cyclictest36363122sleep323:49:563
32509949911951,1191cyclictest33789212sleep320:49:563
32509949911710,1167cyclictest32845942sleep319:34:573
32509949911610,1157cyclictest33160922sleep319:59:563
3250994993490,345cyclictest3578106-21turbostat23:14:563
3250994993490,345cyclictest3578106-21turbostat23:14:553
325099499482,43cyclictest3527447-21turbostat22:35:003
72699320,7ntpd0-21swapper/023:15:190
72699240,7ntpd3384314-21ntpq20:50:211
72699240,2ntpd0-21swapper/020:40:200
72699230,7ntpd3532839-21ntpq22:35:202
72699230,7ntpd3365530-21ntpq20:35:192
72699220,8ntpd3639396-21grep23:50:160
72699220,7ntpd3709176-21cat00:40:000
72699220,7ntpd3525564-21ntpq22:30:180
72699220,7ntpd3452979-21ntpq21:40:220
72699220,7ntpd0-21swapper/019:55:230
72699220,6ntpd3629404-21apt-get23:45:110
72699220,6ntpd3609023-21irqstats23:30:140
72699220,6ntpd3476779-21apt-get22:00:110
72699220,6ntpd3455045-21apt-get21:45:120
72699220,6ntpd3335131-21apt-get20:15:121
72699220,5ntpd3598308-21ntpq23:20:190
72699220,5ntpd3489106-21ntpq22:05:190
72699220,5ntpd3404321-21apt-get21:10:111
72699220,10ntpd3540152-21ntpq22:40:200
72699210,8ntpd3440535-21/usr/sbin/munin21:35:191
72699210,7ntpd3677529-21cut00:15:150
72699210,7ntpd3505551-21cat22:20:001
72699210,6ntpd3572547-21ps23:05:170
72699210,6ntpd3547389-21ntpq22:45:231
72699210,6ntpd3542255-21apt-get22:45:142
72699210,6ntpd3409381-21ssh21:10:190
72699210,6ntpd3390552-21ntpq20:55:202
72699210,6ntpd3296487-21cat19:40:230
72699210,5ntpd3695035-21diskstats00:30:120
72699210,5ntpd3671101-21ntpq00:10:220
72699210,5ntpd3598253-21ntpq23:20:182
72699210,5ntpd3518127-21ntp_states22:25:210
72699210,5ntpd3510903-21ntp_states22:20:210
72699210,5ntpd3462411-21df21:50:120
72699210,5ntpd3462254-21apt-get21:50:111
72699210,5ntpd3385465-21apt-get20:55:111
72699210,5ntpd3359237-21ntpq20:30:182
72699210,5ntpd3283674-21ntpq19:30:191
72699210,5ntpd3278768-21df_inode19:30:122
72699210,3ntpd3483987-21ssh22:05:122
72699210,2ntpd0-21swapper/000:00:200
72699210,10ntpd3490551-21kworker/0:2+kacpid23:27:220
72699210,10ntpd3391725-21/usr/sbin/munin21:00:242
72699200,7ntpd44-21ksoftirqd/221:20:192
72699200,7ntpd3273857-21grep19:25:161
72699200,6ntpd3673386-21tune2fs00:15:111
72699200,6ntpd3569118-21awk23:00:202
72699200,5ntpd3678417-21ps00:15:202
72699200,5ntpd3651535-21apt-get00:00:111
72699200,5ntpd3629550-21df23:45:122
72699200,5ntpd3607663-21apt-get23:30:102
72699200,5ntpd3590826-21ntpq23:15:191
72699200,5ntpd3578383-21apt-get23:10:111
72699200,5ntpd3578383-21apt-get23:10:111
72699200,5ntpd3569587-21users23:00:230
72699200,5ntpd3496573-21python322:10:220
72699200,5ntpd3474412-21memory21:55:180
72699200,5ntpd3416680-21ntpq21:15:190
72699200,5ntpd3333980-21ntp_states20:10:210
72699200,5ntpd3321503-21ntp_states20:00:191
72699200,5ntpd3315188-21ntpq19:55:222
72699200,5ntpd3290002-21ntp_states19:35:221
72699200,5ntpd3272499-21diskstats19:25:132
72699200,5ntpd3256229-21ntpq19:10:190
72699200,4ntpd3658736-21apt-get00:05:110
72699200,4ntpd3644158-21ssh23:55:121
72699200,4ntpd3391757-21apt-get21:00:120
72699200,4ntpd3297113-21apt-get19:45:012
72699200,3ntpd3614911-21ssh23:35:111
72699200,2ntpd0-21swapper/222:00:212
72699200,2ntpd0-21swapper/120:05:211
325099499200,16cyclictest35497292sleep322:50:143
72699190,8ntpd3296785-21kworker/u16:0+xprtiod21:16:351
72699190,6ntpd3623757-21cut23:40:171
72699190,6ntpd3622801-21cut23:40:162
72699190,6ntpd3583560-21uname23:10:212
72699190,6ntpd3583560-21uname23:10:202
72699190,6ntpd0-21swapper/019:15:200
72699190,5ntpd3663804-21ntpq00:05:192
72699190,5ntpd3657462-21ssh00:01:272
72699190,5ntpd3620004-21ntpq23:35:190
72699190,5ntpd3554808-21sensors_temp22:50:240
72699190,5ntpd3516086-21kthreadcore22:25:172
72699190,5ntpd3504379-21ssh22:16:150
72699190,5ntpd3489050-21ntpq22:05:181
72699190,5ntpd3483262-21ssh22:03:261
72699190,5ntpd3454147-21ssh21:42:571
72699190,5ntpd3440736-21diskstats21:35:130
72699190,5ntpd3379372-21diskstats20:50:130
72699190,5ntpd3378935-21idleruntime-cro20:50:002
72699190,5ntpd3291303-21df19:40:121
72699190,5ntpd3289951-21ntpq19:35:202
72699190,5ntpd3245089-21df19:05:110
72699190,4ntpd3687630-21ssh00:25:111
72699190,4ntpd3634614-21ntpq23:45:211
72699190,4ntpd3525681-21ntpq22:30:202
72699190,4ntpd3398177-21df21:05:101
72699190,4ntpd3346556-21ntpq20:20:201
72699190,4ntpd3327750-21ntpq20:05:212
72699190,3ntpd3702077-21ssh00:35:121
72699180,6ntpd3701217-21chrt00:32:581
72699180,6ntpd3551501-21kthreadcore22:50:171
72699180,6ntpd3267293-21irqrtprio19:20:132
72699180,5ntpd3649866-21sh23:55:302
72699180,5ntpd3649249-21ntpq23:55:200
72699180,5ntpd3603579-21kthreadcore23:25:181
72699180,5ntpd3588499-21kthreadcore23:15:142
72699180,5ntpd3521240-21irqcore22:30:141
72699180,5ntpd3496361-21seq22:10:192
72699180,5ntpd3438471-21ntpq21:30:192
72699180,5ntpd3433517-21forks21:30:120
72699180,5ntpd3371822-21ld20:40:211
72699180,5ntpd3264504-21cut19:15:182
72699180,5ntpd3256181-21awk19:10:181
72699180,4ntpd3692768-21ssh00:25:200
72699180,4ntpd3686408-21ssh00:21:352
72699180,4ntpd3584146-21ssh23:10:390
72699180,4ntpd3584146-21ssh23:10:390
72699180,4ntpd3569073-21ntpq23:00:191
72699180,4ntpd3533995-21ssh22:37:280
72699180,4ntpd3533109-21ssh22:35:241
72699180,4ntpd3518077-21ssh22:25:201
72699180,4ntpd3461095-21ssh21:46:531
72699180,4ntpd3446483-21ssh21:36:182
72699180,4ntpd3426236-21diskstats21:25:142
72699180,4ntpd3423767-21ssh21:20:181
72699180,4ntpd3409437-21ld21:10:212
72699180,4ntpd3378235-21python320:45:230
72699180,3ntpd3562400-21ssh22:55:350
72699180,3ntpd3476376-21ssh21:59:472
72699180,3ntpd3447780-21ssh21:40:112
72699180,1ntpd0-21swapper/221:15:202
325099499187,7cyclictest34117552sleep321:15:133
325099499186,8cyclictest3534686-21turbostat22:40:003
72699170,5ntpd3667327-21kthreadcore00:10:161
72699170,5ntpd3467831-21unixbench-2d21:50:242
72699170,5ntpd3366479-21munin-run20:40:001
72699170,4ntpd3694835-21/usr/sbin/munin00:30:212
72699170,4ntpd3688689-21irqrtprio00:25:152
72699170,4ntpd3665938-21apt-get00:10:112
72699170,4ntpd3665453-21ssh00:09:211
72699170,4ntpd3637106-21grep23:50:131
72699170,4ntpd3563380-21ssh22:59:151
72699170,4ntpd3562719-21ssh22:56:452
72699170,4ntpd3506051-21cat22:20:141
72699170,4ntpd3460167-21ld21:45:212
72699170,4ntpd3435525-21grep21:30:151
72699170,4ntpd3379497-21/usr/sbin/munin20:50:142
72699170,4ntpd3342368-21cut20:20:140
72699170,4ntpd3323861-21irqrtprio20:05:150
72699170,4ntpd3278986-21cut19:30:140
72699170,3ntpd3642112-21ssh23:50:212
72699170,3ntpd3599009-21ssh23:20:541
72699170,3ntpd3431216-21ssh21:25:211
72699170,3ntpd3316175-21latency_hist20:00:001
72699170,3ntpd3268421-21cut19:20:151
72699170,3ntpd0-21swapper/222:20:162
72699170,2ntpd3469473-21ssh21:55:101
72699170,2ntpd0-21swapper/120:25:111
72699170,2ntpd0-21swapper/000:20:240
325099499176,7cyclictest35371332sleep322:40:173
3250994991714,1cyclictest0-21swapper/300:00:013
72699160,4ntpd3577218-21ssh23:06:462
72699160,4ntpd3548582-21chrt22:47:500
72699160,4ntpd3498802-21cat22:15:152
72699160,4ntpd3347425-21/usr/sbin/munin20:25:002
72699160,4ntpd3287841-21kthreadcore19:35:180
72699160,3ntpd3616824-21ssh23:35:162
72699160,3ntpd3610385-21kthreadcore23:30:151
72699160,3ntpd3426068-21apt21:25:120
72699160,3ntpd3374759-21cut20:45:151
72699160,3ntpd3355984-21kthreadcore20:30:161
72699160,3ntpd3257635-21ps19:15:021
72699160,2ntpd3540418-21find22:40:232
72699160,2ntpd0-21swapper/223:25:132
72699160,2ntpd0-21swapper/220:40:122
72699160,2ntpd0-21swapper/219:50:132
72699160,2ntpd0-21swapper/219:05:112
72699160,2ntpd0-21swapper/100:20:231
72699160,2ntpd0-21swapper/023:40:210
72699160,2ntpd0-21swapper/021:20:110
72699160,2ntpd0-21swapper/020:35:210
325099499165,7cyclictest32628362sleep319:15:173
3250994991613,1cyclictest0-21swapper/323:35:443
3250994991613,1cyclictest0-21swapper/323:25:163
325099499161,11cyclictest3665945-21taskset00:10:123
325099499161,11cyclictest3460208-21taskset21:45:223
325099499161,11cyclictest3333248-21taskset20:10:173
325099499161,11cyclictest3284890-21taskset19:35:123
72699150,3ntpd3708237-21ssh00:37:152
72699150,3ntpd3577116-21ssh23:06:241
72699150,3ntpd3298523-21irqrtprio19:45:140
72699150,2ntpd3540065-21ssh22:40:191
72699150,2ntpd0-21swapper/222:50:212
72699150,2ntpd0-21swapper/220:25:192
72699150,2ntpd0-21swapper/220:15:212
72699150,2ntpd0-21swapper/220:10:212
72699150,2ntpd0-21swapper/220:00:112
72699150,2ntpd0-21swapper/219:10:212
72699150,2ntpd0-21swapper/122:10:201
72699150,2ntpd0-21swapper/121:00:191
72699150,2ntpd0-21swapper/119:50:221
72699150,2ntpd0-21swapper/119:45:201
72699150,2ntpd0-21swapper/119:05:201
72699150,2ntpd0-21swapper/021:05:170
72699150,2ntpd0-21swapper/020:25:210
72699150,2ntpd0-21swapper/020:15:190
72699150,2ntpd0-21swapper/019:20:180
72699150,1ntpd0-21swapper/221:05:092
72699150,1ntpd0-21swapper/019:25:120
325099499156,6cyclictest3592576-21turbostat23:20:003
325099499155,7cyclictest34393552sleep321:31:403
325099499155,7cyclictest33350982sleep320:15:113
325099499155,7cyclictest32660042sleep319:20:023
3250994991513,1cyclictest0-21swapper/322:26:533
3250994991512,1cyclictest0-21swapper/322:55:163
3250994991512,1cyclictest0-21swapper/320:53:423
3250994991512,1cyclictest0-21swapper/320:34:033
3250994991512,1cyclictest0-21swapper/319:40:113
325099499151,11cyclictest3643819-21taskset23:54:573
325099499151,11cyclictest3599795-21chrt23:23:513
325099499151,11cyclictest3549048-21taskset22:49:373
325099499151,10cyclictest3658741-21chrt00:05:123
325099499151,10cyclictest3440575-21taskset21:35:123
72699140,2ntpd0-21swapper/020:55:150
72699140,2ntpd0-21swapper/020:30:200
72699140,2ntpd0-21swapper/019:50:270
72699140,1ntpd0-21swapper/219:40:112
72699140,1ntpd0-21swapper/020:00:180
325099499145,7cyclictest3410303-21taskset21:11:293
325099499144,7cyclictest3504586-21taskset22:16:593
325099499144,7cyclictest3491153-21taskset22:10:023
325099499144,7cyclictest3475256-21taskset21:55:403
325099499144,7cyclictest34538022sleep321:41:383
3250994991412,1cyclictest0-21swapper/321:27:553
3250994991412,0cyclictest0-21swapper/322:06:343
3250994991412,0cyclictest0-21swapper/319:26:423
3250994991411,1cyclictest0-21swapper/322:20:243
3250994991411,1cyclictest0-21swapper/319:54:153
3250994991411,1cyclictest0-21swapper/300:35:203
325099499141,10cyclictest3693500-21chrt00:26:073
325099499141,10cyclictest3687247-21chrt00:24:433
325099499141,10cyclictest3678500-21chrt00:15:213
325099499141,10cyclictest3628273-21taskset23:41:593
325099499141,10cyclictest3612628-21taskset23:30:173
325099499141,10cyclictest3571157-21taskset23:05:123
325099499141,10cyclictest3468046-21taskset21:50:483
325099499141,10cyclictest3392100-21taskset21:00:143
325099499141,10cyclictest3390601-21taskset20:55:223
325099499141,10cyclictest3372393-21taskset20:41:243
325099499141,10cyclictest3347354-21taskset20:24:243
325099499141,10cyclictest3322610-21taskset20:05:013
325099499140,11cyclictest3366168-21chrt20:36:223
72699130,1ntpd0-21swapper/120:10:201
325099499131,9cyclictest3476947-21taskset22:00:123
3250994991311,1cyclictest0-21swapper/321:05:013
3250994991310,1cyclictest0-21swapper/323:00:153
325099499130,10cyclictest3700503-21taskset00:30:233
325099499130,10cyclictest3651500-21taskset00:00:103
325099499130,10cyclictest3424632-21taskset21:20:453
325099499130,10cyclictest3347916-21taskset20:25:083
325099499130,10cyclictest3297600-21taskset19:45:023
325099499130,10cyclictest3251142-21taskset19:10:033
325099499125,5cyclictest3322046-21taskset20:00:533
32508442111,6sleep30-21swapper/319:10:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional