You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 06:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Fri Jun 12, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2530582994840,5cyclictest438-21cron00:20:002
2530582994840,5cyclictest438-21cron00:20:002
2530577994740,4cyclictest2572715-21latency_hist21:10:001
2530577994740,4cyclictest2572715-21latency_hist21:10:001
2530577994638,5cyclictest2565864-21idleruntime-cro20:50:001
2530586994532,9cyclictest2591667-21auditctl22:05:013
253057399456,6cyclictest131rcu_preempt22:40:150
2530586994430,10cyclictest2553697-21apt20:15:013
2530582994434,7cyclictest2577602-21grep21:20:252
2530586994335,5cyclictest2610638-21sh23:00:003
2530582994336,5cyclictest2594698-21kworker/u8:3+events_unbound22:12:322
2530586994133,5cyclictest2633650-21cron00:05:013
2530577994133,5cyclictest2574606-21idleruntime-cro21:15:011
2530577994130,8cyclictest231ktimers/120:50:131
2530573994129,7cyclictest0-21swapper/022:30:270
2530586994011,9cyclictest2635720-21forks00:10:153
2530582994033,5cyclictest2594698-21kworker/u8:3+events_unbound22:32:352
253057399404,4cyclictest131rcu_preempt19:15:130
2530573994033,4cyclictest2603590-21cron22:40:000
2530573994033,4cyclictest0-21swapper/023:35:010
2530573994031,6cyclictest0-21swapper/020:10:010
2530582993932,4cyclictest2559030-21cron20:30:002
2530582993928,7cyclictest2554977-21grep20:15:272
2530577993932,4cyclictest2603595-21apt-get22:40:001
2530577993931,6cyclictest2621503-21cron23:30:011
2530577993926,10cyclictest231ktimers/123:45:121
2530573993932,3cyclictest0-21swapper/023:05:000
2530573993928,7cyclictest2596307-21grep22:15:280
2530586993830,5cyclictest2572688-21munin-run21:10:013
2530586993830,5cyclictest2572688-21munin-run21:10:013
2530586993826,9cyclictest391ktimers/323:30:113
2530586993824,10cyclictest391ktimers/321:15:133
2530577993829,4cyclictest0-21swapper/123:50:161
2530577993828,6cyclictest0-21swapper/123:30:271
2530573993830,4cyclictest0-21swapper/000:00:000
2530582993726,8cyclictest0-21swapper/219:40:012
2530582993714,5cyclictest131rcu_preempt21:05:102
2530582993714,5cyclictest131rcu_preempt21:05:092
2530577993727,7cyclictest2642190-21idleruntime-cro00:29:591
2530573993727,6cyclictest0-21swapper/021:05:240
2530573993727,6cyclictest0-21swapper/021:05:230
2530586993627,5cyclictest0-21swapper/323:20:013
2530586993626,6cyclictest0-21swapper/320:55:003
2530586993626,4cyclictest0-21swapper/323:52:503
2530586993624,7cyclictest2603180-21unixbench_singl22:35:253
2530582993630,4cyclictest2534440-21kworker/u8:3+events_unbound19:27:042
2530582993626,6cyclictest2549817-21grep20:00:262
2530582993626,6cyclictest2549817-21grep20:00:252
2530577993626,6cyclictest0-21swapper/120:20:251
2530573993630,3cyclictest0-21swapper/021:05:010
253057399362,5cyclictest131rcu_preempt00:20:120
253058699359,10cyclictest2626051-21gzip23:40:263
2530586993527,4cyclictest2548595-21sendmail20:00:013
2530586993527,4cyclictest2548595-21sendmail20:00:003
2530586993525,7cyclictest2623438-21apt-get23:35:133
2530586993525,7cyclictest2557409-21cat20:25:023
2530586993524,7cyclictest2599791-21grep22:25:323
2530586993524,7cyclictest2599791-21grep22:25:313
2530586993524,7cyclictest0-21swapper/300:05:253
2530586993523,9cyclictest2640718-21apt-get00:25:113
2530586993523,8cyclictest2612790-21apt-get23:05:113
2530582993528,5cyclictest2600013-21kworker/u8:1+events_unbound22:57:442
2530582993527,4cyclictest0-21swapper/223:15:262
2530582993527,4cyclictest0-21swapper/222:10:012
2530582993524,7cyclictest0-21swapper/223:30:262
2530577993528,4cyclictest2643887-21auditctl00:35:001
2530577993525,7cyclictest2601885-21cron22:35:001
2530577993525,6cyclictest0-21swapper/119:35:001
2530573993526,5cyclictest0-21swapper/020:45:250
253057399352,5cyclictest131rcu_preempt22:50:120
2530573993525,6cyclictest0-21swapper/022:55:260
2530573993525,6cyclictest0-21swapper/022:45:260
253057399352,4cyclictest131rcu_preempt21:50:120
2530573993524,7cyclictest2543053-21grep19:40:250
2530573993524,6cyclictest0-21swapper/019:50:240
253057399351,4cyclictest131rcu_preempt19:25:110
2530586993423,8cyclictest2530733-21apt-get19:10:113
2530586993421,10cyclictest2592741-21/usr/sbin/munin22:05:243
2530586993421,10cyclictest2584781-21sshd21:44:203
2530586993420,11cyclictest2640395-21cron00:23:593
2530586993420,11cyclictest2535747-21/usr/sbin/munin19:20:263
2530582993426,4cyclictest0-21swapper/222:00:002
2530582993426,4cyclictest0-21swapper/200:15:002
2530577993423,7cyclictest0-21swapper/123:15:001
2530573993427,4cyclictest2599720-21unixbench_multi22:25:310
2530573993427,4cyclictest2599720-21unixbench_multi22:25:300
2530573993425,6cyclictest2558574-21unixbench_multi20:25:230
2530586993325,4cyclictest0-21swapper/321:50:253
2530586993319,10cyclictest2601411-21/usr/sbin/munin22:30:263
2530577993325,4cyclictest0-21swapper/121:50:151
2530577993325,4cyclictest0-21swapper/121:17:211
2530577993324,4cyclictest0-21swapper/122:55:271
2530577993323,6cyclictest0-21swapper/120:35:011
2530573993325,4cyclictest0-21swapper/019:50:010
2530573993323,6cyclictest0-21swapper/023:40:010
2530586993225,4cyclictest2550531-21apt-get20:05:133
2530586993225,3cyclictest2569512-21apt-get21:00:123
2530586993222,5cyclictest2638792-21sendmail00:19:593
2530586993222,5cyclictest2638792-21sendmail00:19:593
2530586993220,8cyclictest2619712-21cron23:24:003
2530586993219,10cyclictest2608531-21/usr/sbin/munin22:50:263
2530586993213,14cyclictest2612338-21cron23:05:003
2530582993224,4cyclictest0-21swapper/219:20:152
2530582993213,4cyclictest131rcu_preempt22:55:012
2530577993227,3cyclictest2605748-21kworker/u8:0+events_unbound23:02:471
2530577993224,4cyclictest0-21swapper/123:25:001
2530577993224,4cyclictest0-21swapper/123:20:001
2530577993224,4cyclictest0-21swapper/120:35:251
2530577993223,6cyclictest0-21swapper/121:50:011
2530577993222,6cyclictest0-21swapper/122:10:251
2530577993222,6cyclictest0-21swapper/119:50:011
2530586993125,3cyclictest2627070-21apt-get23:45:123
2530586993123,4cyclictest0-21swapper/321:10:163
2530586993121,7cyclictest391ktimers/320:15:133
2530586993121,7cyclictest2585416-21/usr/sbin/munin21:45:163
2530586993121,7cyclictest2544954-21sshd19:47:213
2530586993121,5cyclictest0-21swapper/320:47:143
2530586993120,8cyclictest2621113-21/usr/sbin/munin23:25:253
2530586993120,8cyclictest2563386-21/usr/sbin/munin20:40:233
2530586993120,7cyclictest2642538-21/usr/sbin/munin00:30:153
2530586993119,9cyclictest2577496-21/usr/sbin/munin21:20:253
2530586993119,9cyclictest2567793-21apt-get20:55:113
2530586993118,9cyclictest2533041-21apt-get19:15:113
2530586993115,13cyclictest2549437-21/usr/sbin/munin20:00:223
2530586993115,13cyclictest2549437-21/usr/sbin/munin20:00:223
253058299312,5cyclictest131rcu_preempt00:00:112
2530582993121,6cyclictest0-21swapper/221:40:272
2530582993120,7cyclictest2627695-21ps23:45:242
2530573993124,4cyclictest2562447-21cat20:40:010
2530573993123,4cyclictest0-21swapper/020:15:010
2530573993120,8cyclictest2550297-21auditctl20:05:010
2530573993120,8cyclictest2550297-21auditctl20:05:000
2530573993114,14cyclictest11-21ksoftirqd/000:05:130
2530586993021,7cyclictest2538819-21/usr/sbin/munin19:30:163
2530586993020,7cyclictest2645415-21cron00:38:003
2530586993020,7cyclictest2630811-21/usr/sbin/munin23:55:183
2530586993020,7cyclictest2615456-21/usr/sbin/munin23:10:233
2530586993020,7cyclictest2598228-21cron22:22:013
2530586993020,7cyclictest2595753-21/usr/sbin/munin22:15:203
2530586993020,7cyclictest2594138-21/usr/sbin/munin22:10:193
2530586993020,7cyclictest2537586-21/usr/sbin/munin19:25:243
2530586993019,8cyclictest2604400-21/usr/sbin/munin22:40:203
2530586993019,8cyclictest2580059-21df21:30:143
2530586993019,7cyclictest2558588-21grep20:25:233
2530586993016,11cyclictest2606486-21/usr/sbin/munin22:45:263
2530586993014,12cyclictest2560881-21cat20:35:013
2530586993011,15cyclictest2542688-21grep19:40:223
2530582993023,4cyclictest0-21swapper/223:10:002
2530582993022,6cyclictest2628386-21kworker/u8:1+events_unbound00:06:402
2530582993022,6cyclictest2562281-21kworker/u8:0+events_unbound20:47:162
2530582993022,4cyclictest0-21swapper/221:35:272
2530582993018,8cyclictest204-21dbus-daemon21:27:232
2530577993023,4cyclictest2555405-21latency_hist20:20:011
2530577993023,4cyclictest0-21swapper/123:35:251
2530577993022,4cyclictest0-21swapper/121:30:151
2530577993022,4cyclictest0-21swapper/119:10:251
2530577993021,5cyclictest0-21swapper/121:40:161
2530573993023,4cyclictest0-21swapper/020:50:250
2530573993022,5cyclictest0-21swapper/021:30:150
253057399301,4cyclictest131rcu_preempt23:45:120
2530586992922,4cyclictest0-21swapper/321:35:263
2530586992921,4cyclictest2545408-21apt-get19:50:123
2530582992923,3cyclictest2545181-21kthreadd19:50:002
2530582992922,5cyclictest2638515-21kworker/u8:1+events_unbound00:32:552
2530582992922,3cyclictest0-21swapper/223:35:152
2530582992920,6cyclictest0-21swapper/219:15:252
253058299291,5cyclictest131rcu_preempt23:55:112
2530577992923,4cyclictest2622846-21kworker/u8:2+events_unbound23:44:401
2530577992921,4cyclictest0-21swapper/121:25:261
2530577992920,6cyclictest0-21swapper/122:10:011
2530577992918,7cyclictest0-21swapper/120:00:261
2530577992918,7cyclictest0-21swapper/120:00:261
2530577992918,7cyclictest0-21swapper/119:22:021
2530573992922,5cyclictest2636144-21kworker/u8:0+events_unbound00:12:510
2530573992920,5cyclictest0-21swapper/023:10:250
2530573992919,6cyclictest0-21swapper/019:55:240
2530573992919,6cyclictest0-21swapper/019:55:240
2530573992919,6cyclictest0-21swapper/000:15:190
2530573992919,6cyclictest0-21swapper/000:15:190
2530573992915,10cyclictest2536248-21awk19:25:010
2530586992818,7cyclictest2561097-21/usr/sbin/munin20:35:163
2530586992818,7cyclictest2540376-21/usr/sbin/munin19:35:133
2530586992814,11cyclictest2589021-21/usr/sbin/munin21:55:213
2530582992820,4cyclictest0-21swapper/219:40:152
2530577992819,6cyclictest0-21swapper/121:00:011
2530577992818,6cyclictest0-21swapper/121:35:261
2530573992821,3cyclictest0-21swapper/000:30:250
2530573992818,7cyclictest2540496-21fschecks_time19:35:160
253057399281,4cyclictest131rcu_preempt21:45:090
2530582992721,4cyclictest2552365-21fschecks_count20:10:152
2530582992720,3cyclictest0-21swapper/222:20:002
2530582992720,3cyclictest0-21swapper/221:50:222
2530582992719,5cyclictest2574136-21grep21:10:262
2530582992719,5cyclictest2534440-21kworker/u8:3+events_unbound19:30:252
2530582992719,5cyclictest0-21swapper/222:25:222
2530582992719,5cyclictest0-21swapper/222:25:212
2530582992719,4cyclictest0-21swapper/223:55:012
2530582992719,4cyclictest0-21swapper/220:35:152
2530577992720,5cyclictest145-21jbd2/mmcblk1p2-822:25:261
2530577992720,5cyclictest145-21jbd2/mmcblk1p2-822:25:261
2530577992718,5cyclictest0-21swapper/122:20:251
2530577992717,8cyclictest2596781-21idleruntime-cro22:20:011
2530577992716,7cyclictest0-21swapper/122:50:261
2530573992721,4cyclictest2641988-21kworker/u8:2+events_unbound00:27:530
2530573992719,4cyclictest0-21swapper/021:30:010
2530573992718,5cyclictest0-21swapper/023:08:310
2530582992620,3cyclictest0-21swapper/220:50:162
2530582992615,8cyclictest2547339-21tune2fs19:55:162
2530582992615,8cyclictest2547339-21tune2fs19:55:162
2530577992620,4cyclictest2613396-21open_inodes23:05:241
2530577992616,6cyclictest0-21swapper/100:10:251
2530577992615,8cyclictest2534700-21date19:20:021
2530577992615,7cyclictest2537740-21grep19:25:241
253057399262,20cyclictest2620223-21sort23:25:150
2530573992620,3cyclictest0-21swapper/019:15:010
2530573992618,5cyclictest0-21swapper/020:35:010
2530582992517,4cyclictest0-21swapper/222:45:272
2530582992516,5cyclictest2568003-21grep20:55:152
2530582992515,7cyclictest2642186-21sh00:29:592
2530582992514,8cyclictest2626234-21sed23:40:272
2530577992518,5cyclictest0-21swapper/100:15:241
2530577992518,5cyclictest0-21swapper/100:15:231
2530577992518,4cyclictest2640054-21unixbench_singl00:20:251
2530577992517,5cyclictest0-21swapper/119:35:161
2530573992519,3cyclictest0-21swapper/022:10:240
2530573992516,5cyclictest0-21swapper/021:10:250
2530573992515,6cyclictest2556685-21grep20:20:240
2530582992419,3cyclictest0-21swapper/219:50:142
2530582992418,3cyclictest0-21swapper/222:40:272
2530582992418,3cyclictest0-21swapper/222:35:142
2530582992417,5cyclictest2620038-21kworker/u8:3+events_unbound23:29:532
2530582992411,8cyclictest204-21dbus-daemon20:32:122
2530577992417,5cyclictest2603539-21kworker/u8:2+events_unbound22:42:401
2530577992417,4cyclictest0-21swapper/120:05:241
2530577992416,5cyclictest0-21swapper/100:40:001
2530577992414,7cyclictest2635215-21seq00:08:171
2530577992413,8cyclictest2605761-21apt-get22:45:121
253057399249,13cyclictest0-21swapper/019:35:010
2530573992418,4cyclictest2641988-21kworker/u8:2+events_unbound00:37:540
2530573992418,3cyclictest0-21swapper/022:00:170
2530573992417,3cyclictest438-21cron21:20:000
253057399241,4cyclictest0-21swapper/021:20:180
253057399241,21cyclictest0-21swapper/023:43:410
2530582992317,4cyclictest2638515-21kworker/u8:1+events_unbound00:37:432
2530582992317,3cyclictest0-21swapper/220:05:212
253058299231,11cyclictest0-21swapper/200:20:112
253058299230,8cyclictest2597817-21switchtime22:20:242
2530577992317,3cyclictest0-21swapper/123:55:241
2530577992317,3cyclictest0-21swapper/120:40:241
2530577992317,3cyclictest0-21swapper/119:40:161
2530577992315,4cyclictest2559047-21idleruntime-cro20:30:011
2530577992313,7cyclictest2576738-21fschecks_time21:20:171
2530573992318,3cyclictest13550irq/42-30be0000.ethernet21:40:110
2530573992317,4cyclictest2612229-21kworker/u8:1+events_unbound23:17:480
2530573992317,4cyclictest13850irq/36-mmc121:40:000
2530573992317,4cyclictest11-21ksoftirqd/022:20:120
2530573992315,5cyclictest0-21swapper/022:05:230
2530573992315,4cyclictest0-21swapper/021:59:480
2530573992313,7cyclictest2563684-21grep20:40:250
2530582992215,5cyclictest2572547-21kworker/u8:0+events_unbound21:15:192
2530582992214,4cyclictest2581360-21sshd21:34:212
2530577992215,4cyclictest0-21swapper/122:00:011
2530577992214,4cyclictest0-21swapper/119:55:151
2530577992214,4cyclictest0-21swapper/119:55:151
253057799221,3cyclictest2545932-21ntp_kernel_err19:50:191
2530577992213,6cyclictest2553584-21seq20:13:431
2530577992211,8cyclictest2632304-21df_inode00:00:151
2530573992216,3cyclictest0-21swapper/020:55:220
2530573992215,4cyclictest0-21swapper/020:15:250
253057399221,19cyclictest0-21swapper/023:50:310
253057399220,20cyclictest0-21swapper/023:23:390
2530582992115,3cyclictest0-21swapper/222:05:012
2530582992115,3cyclictest0-21swapper/220:40:222
2530582992114,5cyclictest2568881-21kworker/u8:0+events_unbound21:00:202
2530577992115,3cyclictest0-21swapper/121:00:221
2530577992113,5cyclictest231ktimers/122:00:141
2530573992111,6cyclictest2632370-21tune2fs00:00:160
2530582992014,4cyclictest311ktimers/219:10:222
253058299200,4cyclictest131rcu_preempt23:00:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional