You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 08:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Mon Mar 30, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2589907995238,11cyclictest231ktimers/119:10:121
2589899994634,7cyclictest2633497-21grep21:15:010
2589913994535,4cyclictest0-21swapper/200:04:592
2589919994329,11cyclictest391ktimers/320:05:113
2589907994228,10cyclictest231ktimers/120:50:111
2589913994132,6cyclictest2631365-21unixbench_singl21:05:272
2589913994131,6cyclictest0-21swapper/223:35:002
2589913994130,9cyclictest2664281-21kworker/u8:0+events_unbound22:55:102
2589913994130,9cyclictest2664281-21kworker/u8:0+events_unbound22:55:092
2589913994129,7cyclictest0-21swapper/223:40:262
2589907994028,8cyclictest2597019-21grep19:25:261
2589907993929,6cyclictest0-21swapper/123:40:001
258989999397,24cyclictest11-21ksoftirqd/021:10:000
2589899993927,7cyclictest0-21swapper/021:20:010
2589919993827,7cyclictest2676555-21sendmail23:20:003
2589913993829,6cyclictest311ktimers/200:25:122
2589907993829,5cyclictest0-21swapper/100:05:161
2589907993826,8cyclictest2674830-21sh23:15:001
2589899993831,4cyclictest2597066-21head19:25:270
2589899993828,6cyclictest0-21swapper/020:40:000
2589899993819,9cyclictest2597525-1kworker/0:1H+mmc_complete21:45:010
2589907993728,4cyclictest0-21swapper/122:20:011
2589907993728,4cyclictest0-21swapper/122:20:001
2589899993729,4cyclictest2-21kthreadd22:05:010
2589919993627,5cyclictest0-21swapper/320:05:023
2589919993625,5cyclictest0-21swapper/300:40:003
2589913993630,4cyclictest2690393-21munin-plugin-st23:59:592
2589907993626,6cyclictest0-21swapper/120:05:251
2589907993624,7cyclictest2684882-21head23:40:251
2589907993624,7cyclictest0-21swapper/123:25:251
2589899993624,7cyclictest0-21swapper/000:10:250
2589899993624,7cyclictest0-21swapper/000:10:250
2589899993619,14cyclictest121ktimers/023:09:110
2589919993527,4cyclictest0-21swapper/321:40:013
2589919993525,6cyclictest0-21swapper/320:30:273
2589913993527,4cyclictest0-21swapper/223:50:002
2589913993524,7cyclictest2603863-21grep19:45:262
2589913993522,9cyclictest2628358-21sh21:00:012
2589907993527,5cyclictest2653959-21idleruntime-cro22:15:001
2589899993527,5cyclictest0-21swapper/020:05:010
2589899993511,12cyclictest0-21swapper/022:45:000
258989999350,8cyclictest11-21ksoftirqd/019:40:010
2589919993426,4cyclictest0-21swapper/320:10:173
2589919993424,6cyclictest0-21swapper/322:50:013
2589913993426,4cyclictest0-21swapper/220:45:002
2589913993425,5cyclictest2597021-21unixbench_multi19:25:262
2589907993425,4cyclictest0-21swapper/122:30:161
2589907993424,7cyclictest2631312-21grep21:05:271
2589907993423,7cyclictest2628360-21auditctl21:00:001
258989999344,21cyclictest11-21ksoftirqd/000:10:000
2589899993423,4cyclictest131rcu_preempt23:50:200
2589899993422,6cyclictest131rcu_preempt23:13:500
2589899993418,9cyclictest131rcu_preempt21:36:370
2589899993413,14cyclictest131rcu_preempt22:55:010
2589899993413,14cyclictest131rcu_preempt22:55:000
258991999336,9cyclictest0-21swapper/321:20:233
2589919993325,4cyclictest0-21swapper/321:45:273
2589919993325,4cyclictest0-21swapper/300:35:003
2589919993318,3cyclictest131rcu_preempt22:20:173
2589919993318,3cyclictest131rcu_preempt22:20:173
2589913993326,4cyclictest2679968-21munin-plugin-st23:30:002
2589913993323,6cyclictest2638145-21grep21:25:292
2589907993326,4cyclictest2634708-21unixbench_multi21:15:261
2589907993325,4cyclictest0-21swapper/123:09:591
2589907993325,3cyclictest0-21swapper/120:30:171
2589907993324,4cyclictest0-21swapper/122:00:011
2589907993322,7cyclictest2615758-21grep20:20:251
2589907993322,7cyclictest0-21swapper/122:20:251
2589907993322,7cyclictest0-21swapper/122:20:251
258989999332,6cyclictest11-21ksoftirqd/022:50:010
2589899993325,4cyclictest0-21swapper/000:20:240
2589899993324,6cyclictest0-21swapper/020:55:010
2589899993315,3cyclictest131rcu_preempt22:16:240
2589899993315,3cyclictest131rcu_preempt22:16:240
2589899993312,5cyclictest11-21ksoftirqd/021:50:000
2589899993311,4cyclictest131rcu_preempt20:25:200
2589919993224,4cyclictest0-21swapper/322:15:163
2589919993224,4cyclictest0-21swapper/322:15:163
2589919993223,6cyclictest2693380-21grep00:05:273
2589913993223,6cyclictest2610682-21grep20:05:252
2589913993223,5cyclictest2633063-21unixbench_singl21:10:252
2589913993222,6cyclictest2615761-21unixbench_multi20:20:252
2589907993225,4cyclictest2693437-21kworker/u8:0-ext4-rsv-conversion00:20:001
2589907993224,4cyclictest0-21swapper/119:30:201
2589899993225,3cyclictest0-21swapper/022:35:150
2589899993222,7cyclictest2628445-21wc21:00:000
2589899993221,8cyclictest151rcuc/023:55:210
2589899993218,3cyclictest131rcu_preempt21:55:000
2589899993216,5cyclictest131rcu_preempt21:25:210
2589899993215,5cyclictest131rcu_preempt23:25:140
258991999319,6cyclictest40-21ksoftirqd/322:55:203
258991999319,6cyclictest40-21ksoftirqd/322:55:203
258991999318,6cyclictest40-21ksoftirqd/320:55:213
2589919993123,4cyclictest0-21swapper/322:35:243
2589919993121,6cyclictest2598739-21grep19:30:243
2589919993116,12cyclictest2626033-21/usr/sbin/munin20:50:253
2589913993124,4cyclictest2648839-21munin-run22:00:002
2589913993123,5cyclictest2599161-21sh19:35:002
2589913993122,6cyclictest0-21swapper/220:45:152
2589913993120,7cyclictest2676068-21grep23:15:262
2589907993123,4cyclictest0-21swapper/123:45:251
2589907993122,5cyclictest0-21swapper/119:40:001
2589907993122,4cyclictest2594044-21sh19:20:011
2589907993122,4cyclictest0-21swapper/122:26:441
2589907993122,4cyclictest0-21swapper/121:35:231
258989999318,4cyclictest11-21ksoftirqd/023:45:000
2589899993126,3cyclictest151rcuc/023:20:250
2589899993116,9cyclictest131rcu_preempt20:44:130
2589899993115,4cyclictest131rcu_preempt22:25:220
2589899993113,5cyclictest131rcu_preempt19:20:220
258989999311,23cyclictest0-21swapper/019:50:010
2589899993111,5cyclictest131rcu_preempt20:05:110
2589899993111,5cyclictest131rcu_preempt00:15:140
2589919993025,3cyclictest2624961-21sh20:50:013
2589919993023,3cyclictest0-21swapper/300:25:253
2589919993021,6cyclictest391ktimers/323:37:023
2589919993018,5cyclictest131rcu_preempt22:50:203
2589919993018,5cyclictest131rcu_preempt22:50:203
2589913993022,4cyclictest0-21swapper/222:35:162
2589913993022,4cyclictest0-21swapper/222:06:392
2589913993021,5cyclictest2645423-21cron21:50:012
2589907993023,4cyclictest0-21swapper/119:40:281
2589907993022,4cyclictest0-21swapper/121:25:291
2589907993022,3cyclictest0-21swapper/123:30:021
2589907993021,6cyclictest2604288-21idleruntime-cro19:50:021
2589907993020,6cyclictest2617491-21grep20:25:241
2589907993020,6cyclictest0-21swapper/123:00:231
2589907993017,8cyclictest1-21systemd19:51:151
258989999308,6cyclictest11-21ksoftirqd/023:15:170
2589899993023,4cyclictest0-21swapper/000:40:000
2589899993022,6cyclictest2646783-21kworker/u8:3+events_unbound22:32:130
2589899993021,7cyclictest121ktimers/021:30:210
2589899993016,11cyclictest121ktimers/022:10:170
2589899993015,9cyclictest131rcu_preempt21:55:280
2589899993014,3cyclictest131rcu_preempt20:10:160
2589899993012,5cyclictest131rcu_preempt20:30:150
2589899993012,4cyclictest131rcu_preempt00:25:240
2589899993012,11cyclictest131rcu_preempt21:24:330
2589899993011,5cyclictest131rcu_preempt21:00:200
2589899993011,5cyclictest131rcu_preempt19:15:190
2589919992921,5cyclictest0-21swapper/323:10:233
2589919992921,4cyclictest0-21swapper/319:40:263
2589919992920,5cyclictest2589891-21cyclictest23:20:113
2589919992916,8cyclictest2696856-21sshd00:15:573
2589919992910,8cyclictest131rcu_preempt00:20:203
2589913992922,4cyclictest0-21swapper/200:20:232
2589913992921,5cyclictest2607698-21cut20:00:012
258989999294,7cyclictest11-21ksoftirqd/000:30:150
2589899992921,5cyclictest0-21swapper/019:55:270
2589899992917,3cyclictest131rcu_preempt23:45:240
2589899992914,5cyclictest131rcu_preempt23:30:150
2589899992914,4cyclictest0-21swapper/022:55:010
2589899992914,4cyclictest0-21swapper/022:55:010
2589899992913,5cyclictest131rcu_preempt22:20:230
2589899992913,5cyclictest131rcu_preempt22:20:230
2589899992913,4cyclictest131rcu_preempt19:54:160
258989999291,20cyclictest0-21swapper/023:35:190
2589899992910,5cyclictest131rcu_preempt22:05:190
2589899992910,5cyclictest131rcu_preempt20:45:120
2589899992910,4cyclictest131rcu_preempt19:30:170
258991999289,8cyclictest131rcu_preempt19:38:163
258991999289,5cyclictest40-21ksoftirqd/321:10:413
2589919992821,3cyclictest0-21swapper/322:30:013
2589919992819,7cyclictest2694038-21/usr/sbin/munin00:10:233
2589919992819,7cyclictest2694038-21/usr/sbin/munin00:10:233
2589919992816,8cyclictest2681383-21grep23:30:253
2589919992811,7cyclictest131rcu_preempt23:48:473
2589919992810,4cyclictest40-21ksoftirqd/322:11:373
2589913992822,4cyclictest2658813-21unixbench_multi22:25:252
2589913992822,3cyclictest0-21swapper/221:15:182
2589913992821,4cyclictest0-21swapper/219:20:152
2589913992820,4cyclictest0-21swapper/220:10:262
2589913992818,7cyclictest2666314-21auditctl22:50:002
2589907992821,3cyclictest0-21swapper/120:20:011
2589907992819,6cyclictest2632013-21kworker/u8:0+events_unbound21:41:361
258989999281,8cyclictest11-21ksoftirqd/020:20:160
2589899992814,4cyclictest131rcu_preempt00:01:110
2589899992811,4cyclictest0-21swapper/023:00:190
2589899992810,5cyclictest131rcu_preempt19:35:190
2589899992810,5cyclictest131rcu_preempt19:10:110
2589919992719,5cyclictest2595299-21unixbench_multi19:20:253
2589919992716,8cyclictest2691387-21/usr/sbin/munin00:00:243
2589919992716,8cyclictest2649634-21/usr/sbin/munin22:00:213
2589919992716,8cyclictest2603350-21ntp_kernel_pll_19:45:213
2589919992715,9cyclictest2648742-21cron21:59:003
2589919992713,11cyclictest2678860-21/usr/sbin/munin23:25:173
2589919992710,9cyclictest131rcu_preempt23:09:133
2589919992710,7cyclictest131rcu_preempt19:11:073
2589913992715,8cyclictest204-21dbus-daemon20:01:172
2589907992721,3cyclictest0-21swapper/123:15:221
2589907992719,4cyclictest0-21swapper/120:01:161
2589907992719,4cyclictest0-21swapper/100:25:141
2589907992717,7cyclictest0-21swapper/120:15:011
2589907992717,6cyclictest0-21swapper/123:20:161
2589899992716,3cyclictest131rcu_preempt20:15:270
258991999268,5cyclictest40-21ksoftirqd/323:55:113
258991999267,8cyclictest131rcu_preempt23:50:133
258991999267,4cyclictest40-21ksoftirqd/321:25:433
2589919992615,8cyclictest2645940-21/usr/sbin/munin21:50:173
2589919992614,9cyclictest2664522-21cron22:44:003
2589919992614,9cyclictest2642605-21/usr/sbin/munin21:40:183
2589919992612,7cyclictest131rcu_preempt19:51:353
258991999261,15cyclictest0-21swapper/320:27:593
2589919992610,8cyclictest131rcu_preempt19:18:443
2589913992617,6cyclictest2692830-21sort00:05:212
2589907992620,3cyclictest0-21swapper/122:55:231
2589907992620,3cyclictest0-21swapper/122:55:231
2589907992619,3cyclictest0-21swapper/121:15:001
2589907992617,6cyclictest53-21kcompactd020:40:121
2589907992616,6cyclictest0-21swapper/100:30:151
258991999259,7cyclictest131rcu_preempt21:08:383
2589919992518,4cyclictest0-21swapper/321:00:263
2589919992514,8cyclictest2660068-21/usr/sbin/munin22:30:193
2589919992514,8cyclictest2620105-21/usr/sbin/munin20:35:163
2589919992514,8cyclictest2614758-21munin-node20:20:123
2589919992514,8cyclictest2606783-21/usr/sbin/munin19:55:223
2589919992513,5cyclictest131rcu_preempt23:40:173
2589919992510,8cyclictest131rcu_preempt22:06:563
2589919992510,8cyclictest131rcu_preempt19:25:213
2589913992518,4cyclictest0-21swapper/223:10:142
2589913992517,6cyclictest2660886-21kworker/u8:1+events_unbound22:41:482
2589913992516,5cyclictest0-21swapper/223:01:532
2589913992514,8cyclictest311ktimers/220:35:132
2589913992513,8cyclictest2655677-21tr22:20:012
2589913992513,8cyclictest2655677-21tr22:20:012
2589907992519,3cyclictest0-21swapper/121:30:251
2589907992517,5cyclictest0-21swapper/120:35:151
2589907992517,4cyclictest0-21swapper/121:00:181
2589907992514,3cyclictest2594584-21if_eth019:20:171
258991999242,16cyclictest40-21ksoftirqd/321:15:183
2589919992414,7cyclictest2621787-21/usr/sbin/munin20:40:223
2589919992414,7cyclictest2613275-21/usr/sbin/munin20:15:183
258991999241,15cyclictest0-21swapper/323:00:053
2589913992419,3cyclictest0-21swapper/219:50:242
2589913992418,3cyclictest2642032-21sendmail21:40:002
2589913992417,5cyclictest311ktimers/200:15:012
2589913992417,5cyclictest311ktimers/200:15:012
2589913992417,4cyclictest2619221-21head20:30:282
2589913992415,6cyclictest0-21swapper/221:30:152
2589913992415,6cyclictest0-21swapper/220:20:002
2589913992414,7cyclictest2653962-21grep22:15:012
2589907992417,4cyclictest2636583-21kworker/u8:1+events_unbound21:51:381
2589907992417,3cyclictest0-21swapper/122:05:011
2589907992416,5cyclictest0-21swapper/122:40:011
2589907992416,5cyclictest0-21swapper/100:35:171
2589907992416,4cyclictest0-21swapper/100:00:001
2589907992413,7cyclictest0-21swapper/121:25:001
258991999238,6cyclictest131rcu_preempt21:31:183
2589913992317,3cyclictest0-21swapper/223:20:252
2589913992316,3cyclictest2702743-21fschecks_time00:35:172
2589913992315,5cyclictest0-21swapper/219:35:162
2589913992315,5cyclictest0-21swapper/219:15:012
2589913992314,6cyclictest0-21swapper/220:50:252
2589907992317,3cyclictest0-21swapper/122:50:011
2589907992315,4cyclictest0-21swapper/119:55:261
2589907992313,6cyclictest0-21swapper/123:50:251
2589907992312,8cyclictest2666712-21cut22:50:131
2589907992312,8cyclictest2666712-21cut22:50:131
2589913992216,4cyclictest26018622sleep219:40:272
2589913992216,3cyclictest0-21swapper/223:37:012
2589913992216,3cyclictest0-21swapper/223:05:142
2589913992215,4cyclictest0-21swapper/219:15:232
2589913992215,3cyclictest0-21swapper/221:50:242
2589907992215,3cyclictest0-21swapper/100:00:201
2589907992212,7cyclictest2623701-21fschecks_time20:45:161
2589913992115,3cyclictest0-21swapper/221:20:162
2589913992115,3cyclictest0-21swapper/200:30:242
2589913992114,4cyclictest0-21swapper/222:20:242
2589913992114,4cyclictest0-21swapper/222:20:242
2589913992112,6cyclictest0-21swapper/220:25:172
2589907992115,3cyclictest0-21swapper/122:05:131
2589907992115,3cyclictest0-21swapper/100:20:141
2589913992014,3cyclictest0-21swapper/222:50:132
2589913992014,3cyclictest0-21swapper/222:50:132
2589913992013,5cyclictest311ktimers/200:15:132
2589913992013,4cyclictest2660766-21head22:30:262
2589913992012,5cyclictest311ktimers/223:50:132
2589907992014,3cyclictest0-21swapper/100:10:181
2589907992014,3cyclictest0-21swapper/100:10:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional