You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 09:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Fri Apr 10, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2527335995238,10cyclictest391ktimers/320:15:133
2527329995220,28cyclictest0-21swapper/119:35:001
2527324995240,8cyclictest2609287-21apt23:05:000
2527331995136,11cyclictest311ktimers/221:25:132
2527329995123,24cyclictest0-21swapper/122:55:141
2527329994723,20cyclictest0-21swapper/120:20:011
2527331994631,12cyclictest311ktimers/222:00:142
2527329994618,4cyclictest0-21swapper/122:25:171
2527324994640,3cyclictest2588606-21cron22:05:010
2527331994539,4cyclictest2556948-21kworker/u8:0+events_unbound23:13:302
2527331994539,4cyclictest2556948-21kworker/u8:0+events_unbound23:13:302
2527329994515,5cyclictest0-21swapper/123:20:001
2527329994513,9cyclictest204-21dbus-daemon21:48:131
2527335994434,8cyclictest391ktimers/322:50:123
2527335994434,7cyclictest2607430-21sshd22:58:253
2527329994318,3cyclictest0-21swapper/120:30:001
2527329994314,5cyclictest0-21swapper/120:55:251
2527335994234,5cyclictest2584975-21cron21:55:003
2527331994234,4cyclictest2558777-21idleruntime-cro20:40:002
2527329994115,3cyclictest0-21swapper/120:10:201
2527324994134,4cyclictest2579654-21latency_hist21:40:000
2527335994032,4cyclictest2548550-21idleruntime-cro20:10:013
2527324994029,6cyclictest0-21swapper/023:15:260
2527331993931,5cyclictest2528958-21apt19:15:002
2527331993929,7cyclictest2629303-21grep00:00:252
2527329993928,7cyclictest0-21swapper/122:45:291
2527329993915,3cyclictest0-21swapper/122:35:211
2527324993922,14cyclictest11-21ksoftirqd/022:15:130
2527335993828,6cyclictest0-21swapper/319:40:023
2527329993828,6cyclictest0-21swapper/120:35:251
2527329993729,4cyclictest0-21swapper/121:40:161
2527329993726,8cyclictest2569036-21latency_hist21:10:001
2527324993727,7cyclictest2628040-21munin-plugin-st00:00:000
2527331993628,4cyclictest0-21swapper/221:45:002
2527331993627,6cyclictest2599211-21fschecks_count22:35:172
2527329993626,6cyclictest2601857-21unixbench_singl22:40:261
2527329993626,6cyclictest0-21swapper/119:40:011
2527329993622,10cyclictest231ktimers/121:25:131
2527331993528,4cyclictest0-21swapper/222:40:262
2527331993527,4cyclictest0-21swapper/220:10:152
2527324993525,6cyclictest0-21swapper/020:50:250
2527324993525,6cyclictest0-21swapper/020:50:250
2527324993525,6cyclictest0-21swapper/000:05:250
2527324993524,8cyclictest2629742-21cron00:05:010
2527335993425,5cyclictest0-21swapper/321:28:113
2527331993426,4cyclictest0-21swapper/222:55:142
2527331993424,7cyclictest2625859-21grep23:50:262
2527329993427,4cyclictest0-21swapper/100:30:151
2527329993427,4cyclictest0-21swapper/100:30:151
2527329993424,7cyclictest0-21swapper/123:20:251
2527329993423,8cyclictest231ktimers/119:55:131
2527329993420,10cyclictest231ktimers/123:50:151
2527329993415,5cyclictest0-21swapper/120:40:141
2527324993427,4cyclictest2621218-21sh23:40:000
2527324993426,3cyclictest0-21swapper/020:40:000
2527324993424,6cyclictest0-21swapper/021:25:000
2527324993424,6cyclictest0-21swapper/000:40:000
2527335993326,4cyclictest0-21swapper/320:20:253
2527331993324,6cyclictest0-21swapper/222:15:172
2527331993317,14cyclictest32-21ksoftirqd/200:35:112
2527329993326,3cyclictest0-21swapper/100:15:261
2527329993325,4cyclictest0-21swapper/100:23:451
2527329993319,10cyclictest231ktimers/121:15:131
2527324993326,4cyclictest2583288-21idleruntime-cro21:50:000
2527324993324,5cyclictest0-21swapper/021:10:010
2527324993323,7cyclictest0-21swapper/021:20:000
2527324993323,6cyclictest0-21swapper/021:40:260
2527324993323,6cyclictest0-21swapper/021:00:160
2527324993323,6cyclictest0-21swapper/000:30:000
2527324993322,8cyclictest2534894-21idleruntime-cro19:30:000
2527324993315,14cyclictest11-21ksoftirqd/023:25:120
2527324993315,14cyclictest11-21ksoftirqd/020:55:120
2527335993222,6cyclictest0-21swapper/321:00:003
2527335993222,6cyclictest0-21swapper/300:35:133
2527335993221,7cyclictest2603534-21grep22:45:303
2527331993225,4cyclictest2631454-21kthreadd00:10:002
2527331993224,4cyclictest0-21swapper/222:10:272
2527324993226,3cyclictest0-21swapper/019:30:260
2527324993223,7cyclictest2579612-21kworker/u8:3+events_unbound22:13:180
2527335993122,5cyclictest2536171-21grep19:30:263
2527335993120,6cyclictest0-21swapper/320:02:543
2527331993124,5cyclictest2543043-21kworker/u8:2+events_unbound20:02:542
2527331993123,4cyclictest0-21swapper/222:05:162
2527331993123,4cyclictest0-21swapper/220:25:172
2527329993123,4cyclictest0-21swapper/122:10:261
2527329993120,7cyclictest0-21swapper/119:15:011
2527324993122,6cyclictest2528961-21sh19:15:010
2527324993120,7cyclictest0-21swapper/019:15:250
2527335993023,4cyclictest0-21swapper/300:05:003
2527335993022,4cyclictest0-21swapper/300:10:253
2527335993021,4cyclictest0-21swapper/323:40:263
2527335993020,8cyclictest2579670-21sendmail21:40:003
2527335993020,6cyclictest0-21swapper/322:40:003
2527331993022,4cyclictest0-21swapper/219:35:162
2527331993021,4cyclictest0-21swapper/223:20:012
2527331993020,6cyclictest0-21swapper/221:10:272
2527331993019,7cyclictest2634854-21apt00:20:002
2527331993017,8cyclictest204-21dbus-daemon23:08:272
2527331993017,8cyclictest204-21dbus-daemon23:08:272
2527329993022,4cyclictest0-21swapper/119:40:251
2527324993018,8cyclictest2556599-21grep20:30:250
2527335992915,9cyclictest204-21dbus-daemon20:38:003
2527331992921,4cyclictest0-21swapper/222:55:002
2527331992921,4cyclictest0-21swapper/200:10:152
2527331992918,7cyclictest2578364-21grep21:35:152
2527329992922,4cyclictest0-21swapper/122:30:261
2527329992921,4cyclictest0-21swapper/120:00:321
2527324992923,3cyclictest0-21swapper/022:35:260
2527324992919,7cyclictest2551515-21grep20:15:260
2527324992919,6cyclictest0-21swapper/023:40:160
2527324992911,15cyclictest0-21swapper/023:05:130
2527324992911,15cyclictest0-21swapper/023:05:130
2527335992820,4cyclictest0-21swapper/322:40:263
2527335992820,4cyclictest0-21swapper/322:30:263
2527335992820,4cyclictest0-21swapper/319:15:253
2527335992819,6cyclictest2538706-21fschecks_count19:40:153
2527335992816,7cyclictest0-21swapper/320:45:263
2527335992816,7cyclictest0-21swapper/320:45:263
2527331992823,3cyclictest2605793-21kworker/u8:1+events_unbound23:48:362
2527331992820,5cyclictest311ktimers/220:40:112
2527331992820,4cyclictest0-21swapper/220:17:572
2527329992818,6cyclictest0-21swapper/123:30:241
2527324992821,3cyclictest0-21swapper/000:10:250
2527324992820,5cyclictest0-21swapper/022:50:260
2527324992819,5cyclictest0-21swapper/019:55:160
2527324992818,6cyclictest0-21swapper/020:20:250
2527335992720,3cyclictest0-21swapper/300:25:003
2527335992719,4cyclictest0-21swapper/321:05:243
2527335992719,4cyclictest0-21swapper/320:25:183
2527335992716,8cyclictest2594128-21grep22:20:163
2527331992721,4cyclictest2531263-21latency_hist19:20:022
2527331992719,4cyclictest0-21swapper/223:40:002
2527331992719,4cyclictest0-21swapper/222:25:272
2527331992717,4cyclictest0-21swapper/220:30:162
2527331992715,8cyclictest1-21systemd21:08:052
2527329992717,7cyclictest2569543-21cstates21:10:151
2527324992719,5cyclictest0-21swapper/023:00:000
2527324992718,4cyclictest2602256-21idleruntime-cro22:45:000
2527324992717,6cyclictest0-21swapper/020:40:240
2527324992716,8cyclictest2586231-21grep21:55:270
252733599261,8cyclictest2633842-21wc00:15:203
2527335992618,4cyclictest0-21swapper/323:35:263
2527335992618,4cyclictest0-21swapper/322:10:163
2527335992616,6cyclictest204-21dbus-daemon21:33:113
2527331992619,4cyclictest0-21swapper/223:35:002
2527331992616,7cyclictest2572620-21apt21:20:012
2527329992619,5cyclictest0-21swapper/123:55:241
2527329992619,3cyclictest0-21swapper/121:55:011
2527329992618,4cyclictest0-21swapper/122:20:161
2527329992615,8cyclictest1-21systemd22:18:181
2527324992620,4cyclictest2579612-21kworker/u8:3+events_unbound22:30:020
2527324992617,5cyclictest0-21swapper/021:10:220
2527324992616,6cyclictest0-21swapper/022:45:300
2527324992616,6cyclictest0-21swapper/020:50:010
2527324992616,6cyclictest0-21swapper/020:50:000
2527324992615,7cyclictest2546060-21seq20:00:230
2527335992519,4cyclictest164-21systemd-journal21:14:403
2527335992518,4cyclictest0-21swapper/321:15:273
2527335992518,4cyclictest0-21swapper/300:00:003
2527335992518,3cyclictest0-21swapper/321:00:163
2527335992516,6cyclictest0-21swapper/323:10:173
2527335992516,6cyclictest0-21swapper/323:10:163
2527335992516,5cyclictest2619090-21head23:30:243
2527335992516,5cyclictest0-21swapper/319:15:023
2527335992516,5cyclictest0-21swapper/300:35:003
2527335992516,5cyclictest0-21swapper/300:35:003
252733199253,15cyclictest1-21systemd20:53:032
252733199253,15cyclictest1-21systemd20:53:022
2527331992519,3cyclictest2548545-21latency_hist20:10:012
2527331992516,6cyclictest0-21swapper/219:55:262
2527331992516,5cyclictest0-21swapper/221:55:002
2527331992516,5cyclictest0-21swapper/219:30:262
2527329992517,5cyclictest0-21swapper/123:45:261
2527329992515,7cyclictest0-21swapper/120:05:221
2527324992518,4cyclictest11-21ksoftirqd/019:40:120
2527324992517,5cyclictest0-21swapper/020:05:220
2527324992517,5cyclictest0-21swapper/019:55:010
2527324992517,4cyclictest13550irq/42-30be0000.ethernet23:35:000
2527324992516,6cyclictest13550irq/42-30be0000.ethernet20:10:110
2527324992516,6cyclictest121ktimers/021:30:010
2527324992516,6cyclictest0-21swapper/022:35:010
2527324992513,9cyclictest121ktimers/022:20:130
252732499251,20cyclictest0-21swapper/020:27:020
252732499251,20cyclictest0-21swapper/000:35:000
252732499251,20cyclictest0-21swapper/000:34:590
2527335992418,3cyclictest0-21swapper/321:40:163
2527335992418,3cyclictest0-21swapper/320:50:203
2527335992418,3cyclictest0-21swapper/320:50:203
2527335992418,3cyclictest0-21swapper/320:40:183
2527335992418,3cyclictest0-21swapper/300:25:273
2527335992417,5cyclictest164-21systemd-journal23:50:403
2527335992417,3cyclictest0-21swapper/321:55:273
2527335992417,3cyclictest0-21swapper/319:45:173
2527335992417,3cyclictest0-21swapper/319:25:013
2527335992414,6cyclictest2617801-21cron23:30:013
2527331992416,4cyclictest0-21swapper/220:20:202
2527331992413,8cyclictest2564321-21tune2fs20:55:162
2527331992413,6cyclictest2627629-21unixbench_singl23:55:242
2527329992418,3cyclictest0-21swapper/122:50:221
2527329992416,5cyclictest231ktimers/120:20:181
2527329992416,5cyclictest0-21swapper/122:00:001
2527329992416,4cyclictest0-21swapper/100:30:001
2527329992415,6cyclictest0-21swapper/123:10:181
2527329992415,6cyclictest0-21swapper/123:10:181
2527324992417,5cyclictest0-21swapper/023:11:380
2527324992417,5cyclictest0-21swapper/023:11:370
2527324992417,3cyclictest0-21swapper/023:22:170
2527324992416,5cyclictest0-21swapper/021:50:190
2527324992415,5cyclictest0-21swapper/000:20:270
2527324992413,7cyclictest2577960-21grep21:35:000
252732499241,19cyclictest0-21swapper/019:37:100
2527335992317,4cyclictest2579612-21kworker/u8:3+events_unbound21:45:053
2527335992317,3cyclictest0-21swapper/323:15:243
2527335992317,3cyclictest0-21swapper/322:25:223
2527335992316,5cyclictest2537504-21kworker/u8:1+events_unbound19:58:243
2527335992314,6cyclictest2608804-21chrt23:00:243
2527335992313,6cyclictest2557055-21cron20:35:003
2527335992311,8cyclictest1-21systemd19:52:523
2527331992315,5cyclictest0-21swapper/222:45:182
2527331992315,4cyclictest0-21swapper/223:00:252
2527331992314,6cyclictest2635343-21grep00:20:182
2527331992314,6cyclictest2533014-21sort19:25:012
2527331992312,7cyclictest2542355-21grep19:50:182
2527329992317,4cyclictest25558552sleep120:30:181
2527329992317,4cyclictest0-21swapper/123:40:211
2527329992317,3cyclictest0-21swapper/100:35:221
2527329992315,4cyclictest0-21swapper/122:10:001
2527324992317,3cyclictest0-21swapper/019:50:010
2527324992313,7cyclictest0-21swapper/022:05:180
2527335992217,3cyclictest0-21swapper/321:20:153
2527335992216,4cyclictest25872302sleep322:00:153
2527335992216,3cyclictest0-21swapper/322:20:013
2527335992215,3cyclictest0-21swapper/323:05:183
2527335992215,3cyclictest0-21swapper/323:05:183
2527335992215,3cyclictest0-21swapper/320:10:143
252733199223,15cyclictest2573012-21grep21:20:172
2527331992217,3cyclictest2576966-21missed_timers21:30:212
2527331992216,4cyclictest0-21swapper/219:45:012
2527331992216,3cyclictest0-21swapper/221:45:202
2527331992215,3cyclictest0-21swapper/223:20:152
2527331992213,5cyclictest311ktimers/200:30:192
2527331992213,5cyclictest311ktimers/200:30:192
2527331992212,6cyclictest0-21swapper/200:25:272
252733199221,13cyclictest2594152-21cut22:20:162
2527329992214,6cyclictest204-21dbus-daemon19:47:511
252732999221,18cyclictest2578187-21taskset21:35:121
2527329992211,8cyclictest2531314-21sed19:20:011
252732499222,5cyclictest2634885-21sendmail-msp00:20:000
2527335992115,4cyclictest2556948-21kworker/u8:0+events_unbound22:06:123
2527335992112,5cyclictest0-21swapper/323:50:003
252733199213,11cyclictest2586208-21unixbench_multi21:55:272
2527331992115,3cyclictest2565831-21/usr/sbin/munin21:00:202
2527331992112,6cyclictest2540995-21cut19:45:252
2527329992116,3cyclictest0-21swapper/123:00:221
2527329992115,3cyclictest2617917-21latency_hist23:30:021
2527329992114,4cyclictest0-21swapper/120:45:231
2527329992114,4cyclictest0-21swapper/120:45:231
2527329992112,6cyclictest2610982-21sh23:10:001
2527329992112,6cyclictest2610982-21sh23:10:001
252732499210,19cyclictest0-21swapper/023:47:210
2527335992014,3cyclictest0-21swapper/323:20:113
2527335992012,5cyclictest0-21swapper/319:25:013
252733199208,8cyclictest1-21systemd19:27:472
2527331992012,6cyclictest311ktimers/223:25:132
2527331992010,7cyclictest2560809-21awk20:45:142
2527331992010,7cyclictest2560809-21awk20:45:142
252732999202,15cyclictest2629985-21taskset00:05:111
2527329992015,3cyclictest2588353-21sh22:02:001
2527329992015,3cyclictest0-21swapper/123:35:231
2527329992014,3cyclictest0-21swapper/119:50:171
2527329992011,6cyclictest0-21swapper/119:25:201
2527329992011,6cyclictest0-21swapper/100:00:241
2527335991911,6cyclictest391ktimers/300:05:203
2527331991910,6cyclictest2598445-21/usr/sbin/munin22:30:262
2527329991914,3cyclictest0-21swapper/120:50:241
2527329991914,3cyclictest0-21swapper/120:50:241
2527329991913,4cyclictest0-21swapper/121:30:141
2527329991912,5cyclictest231ktimers/100:10:201
2527329991810,4cyclictest0-21swapper/121:20:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional