You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-12 - 10:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sun Jul 12, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2768345995240,10cyclictest311ktimers/219:10:122
2768345995136,12cyclictest311ktimers/200:30:122
2768338995142,6cyclictest2799792-21sendmail20:40:010
2768341995039,8cyclictest2877102-21kworker/u8:2+events_unbound00:25:121
2768349994841,4cyclictest2830685-21cron22:10:013
2768345994532,4cyclictest2813398-21kworker/u8:2+events_unbound21:32:462
2768341994536,6cyclictest2779503-21fschecks_count19:40:151
2768341994531,11cyclictest231ktimers/100:05:121
2768338994537,5cyclictest2769974-21munin-plugin-st19:15:000
2768349994330,8cyclictest2792964-21sendmail20:20:003
2768345994337,4cyclictest2806526-21kworker/u8:0+events_unbound21:02:432
2768345994328,11cyclictest311ktimers/221:10:132
2768345994236,4cyclictest2865002-21kworker/u8:1+events_unbound00:02:592
2768345994236,4cyclictest2773969-21kworker/u8:0+events_unbound19:27:362
2768345994229,4cyclictest131rcu_preempt22:35:522
2768345994135,4cyclictest2820386-21kworker/u8:2+events_unbound21:47:462
2768345994118,10cyclictest2861706-21kworker/u8:2-events_unbound23:46:022
2768349994033,4cyclictest2789125-21unixbench_singl20:05:263
2768349994033,4cyclictest2789125-21unixbench_singl20:05:263
2768345994034,4cyclictest2845956-21kworker/u8:1+events_unbound22:57:532
2768345994016,10cyclictest0-21swapper/223:36:422
2768345993931,5cyclictest2789116-21grep20:05:262
2768345993931,5cyclictest2789116-21grep20:05:262
2768345993929,7cyclictest2834114-21sendmail22:20:002
2768345993921,4cyclictest2845956-21kworker/u8:1-events_freezable_power_23:09:382
2768345993918,10cyclictest131rcu_preempt23:04:482
2768349993826,8cyclictest0-21swapper/321:22:443
2768345993818,4cyclictest0-21swapper/222:00:552
2768345993815,5cyclictest2809681-21kworker/u8:3-writeback21:08:122
2768341993830,4cyclictest0-21swapper/123:35:001
2768345993731,4cyclictest2833743-21kworker/u8:2+events_unbound22:48:402
2768345993731,4cyclictest2833743-21kworker/u8:2+events_unbound22:48:402
2768345993726,7cyclictest2876752-21grep00:20:282
2768345993726,7cyclictest0-21swapper/220:50:262
2768345993726,6cyclictest2812968-21grep21:15:292
2768345993726,4cyclictest131rcu_preempt22:10:332
2768345993722,5cyclictest2873617-21kworker/u8:1-events_freezable_power_00:17:482
2768345993722,4cyclictest131rcu_preempt23:32:042
2768345993722,4cyclictest131rcu_preempt21:35:422
2768345993720,5cyclictest131rcu_preempt23:57:112
2768345993720,3cyclictest0-21swapper/223:18:262
2768345993719,10cyclictest131rcu_preempt20:29:422
2768345993716,10cyclictest131rcu_preempt23:24:172
2768349993625,7cyclictest0-21swapper/320:25:003
2768349993625,6cyclictest0-21swapper/322:20:003
2768345993628,4cyclictest2878459-21unixbench_singl00:25:252
2768345993626,5cyclictest0-21swapper/219:32:342
2768345993622,6cyclictest2861706-21kworker/u8:2+events_unbound23:53:262
2768341993625,7cyclictest2852667-21grep23:10:261
2768338993628,4cyclictest2868632-21auditctl00:00:010
2768338993628,4cyclictest0-21swapper/019:25:010
276833899361,4cyclictest131rcu_preempt23:05:130
2768349993528,4cyclictest2840910-21cron22:40:003
2768349993525,6cyclictest0-21swapper/300:10:003
2768345993525,7cyclictest2839216-21auditctl22:35:002
2768345993522,4cyclictest131rcu_preempt22:26:162
2768345993521,4cyclictest131rcu_preempt19:56:542
2768345993518,3cyclictest0-21swapper/222:23:382
2768345993517,4cyclictest131rcu_preempt22:53:112
2768345993517,3cyclictest0-21swapper/222:41:522
2768345993516,4cyclictest131rcu_preempt23:13:442
2768345993515,10cyclictest131rcu_preempt20:41:302
2768341993524,7cyclictest2882293-21sendmail00:40:001
2768349993424,6cyclictest0-21swapper/322:10:233
2768349993424,6cyclictest0-21swapper/321:15:003
2768349993423,7cyclictest0-21swapper/321:25:253
2768345993428,4cyclictest2869983-21kworker/u8:3+events_unbound00:14:422
2768345993425,5cyclictest0-21swapper/219:20:272
2768345993420,4cyclictest131rcu_preempt19:18:502
2768345993420,4cyclictest131rcu_preempt00:05:032
2768345993418,9cyclictest131rcu_preempt20:37:002
2768345993418,9cyclictest131rcu_preempt20:15:112
2768345993417,5cyclictest131rcu_preempt22:08:162
2768345993417,4cyclictest131rcu_preempt21:52:412
2768345993417,4cyclictest131rcu_preempt20:04:182
2768345993417,4cyclictest131rcu_preempt19:53:532
2768345993417,4cyclictest131rcu_preempt00:38:492
2768345993415,11cyclictest131rcu_preempt19:36:422
276833899341,5cyclictest131rcu_preempt21:30:130
2768349993324,6cyclictest0-21swapper/319:20:273
2768349993323,6cyclictest0-21swapper/321:15:193
2768349993323,6cyclictest0-21swapper/320:55:273
2768345993323,7cyclictest2794202-21grep20:20:272
2768345993322,4cyclictest131rcu_preempt21:26:252
2768345993319,4cyclictest131rcu_preempt21:42:202
2768345993319,4cyclictest131rcu_preempt20:30:302
2768345993318,4cyclictest131rcu_preempt20:59:182
2768345993318,4cyclictest131rcu_preempt19:41:122
2768345993314,9cyclictest131rcu_preempt23:25:092
2768345993311,5cyclictest131rcu_preempt21:25:012
2768341993326,4cyclictest0-21swapper/122:10:241
2768341993325,5cyclictest2813009-21unixbench_singl21:15:291
2768338993326,4cyclictest2785920-21sendmail20:00:010
276833899331,29cyclictest0-21swapper/019:35:130
2768349993223,5cyclictest0-21swapper/323:15:273
2768349993221,7cyclictest0-21swapper/319:10:263
2768345993218,4cyclictest131rcu_preempt20:13:022
2768345993215,4cyclictest131rcu_preempt19:49:352
2768341993226,3cyclictest0-21swapper/121:35:241
2768341993225,5cyclictest2857892-21kworker/u8:0+events_unbound23:27:571
2768341993224,5cyclictest0-21swapper/123:40:001
276834199321,6cyclictest131rcu_preempt21:40:121
2768338993226,3cyclictest2796366-21sh20:30:010
2768338993225,4cyclictest2854778-21latency_hist23:20:000
2768338993224,6cyclictest2856127-21kworker/u8:3+events_unbound23:22:550
2768338993224,4cyclictest0-21swapper/020:05:010
276833899321,5cyclictest131rcu_preempt00:10:120
2768349993122,5cyclictest0-21swapper/322:55:003
2768349993122,5cyclictest0-21swapper/322:00:263
2768349993122,5cyclictest0-21swapper/319:50:173
2768349993122,5cyclictest0-21swapper/300:20:163
2768349993121,6cyclictest0-21swapper/323:05:213
2768349993121,6cyclictest0-21swapper/320:35:263
2768345993118,10cyclictest311ktimers/221:55:162
2768345993115,9cyclictest131rcu_preempt23:41:002
2768341993125,4cyclictest2789488-21kworker/u8:0+events_unbound20:12:401
2768341993124,4cyclictest2847769-21idleruntime-cro23:00:001
2768341993124,4cyclictest2785919-21munin-plugin-st20:00:011
2768341993124,4cyclictest2779095-21cron19:40:011
2768341993123,4cyclictest0-21swapper/120:45:231
2768338993123,4cyclictest0-21swapper/022:10:010
2768338993121,6cyclictest2859639-21grep23:30:250
2768338993121,6cyclictest0-21swapper/000:00:290
2768338993118,10cyclictest121ktimers/021:40:110
276833899311,26cyclictest2872045-21sh00:10:000
2768349993022,4cyclictest0-21swapper/323:50:263
2768349993021,6cyclictest0-21swapper/323:45:163
2768349993021,6cyclictest0-21swapper/323:15:013
2768349993021,5cyclictest0-21swapper/320:45:253
2768341993023,4cyclictest2771791-21unixbench_multi19:15:271
2768341993023,4cyclictest0-21swapper/121:55:291
2768341993022,4cyclictest0-21swapper/122:15:151
2768341993020,6cyclictest2873292-21grep00:10:251
2768341993019,7cyclictest0-21swapper/122:30:261
276833899302,3cyclictest131rcu_preempt19:30:180
2768338993021,4cyclictest0-21swapper/000:20:000
276833899301,11cyclictest28487152awk23:00:210
2768349992923,4cyclictest2820386-21kworker/u8:2+events_unbound21:42:463
2768349992920,6cyclictest2770959-21fschecks_count19:15:173
2768349992920,6cyclictest0-21swapper/300:35:003
2768349992917,9cyclictest391ktimers/323:00:103
2768341992922,4cyclictest0-21swapper/120:00:171
2768341992922,3cyclictest0-21swapper/120:35:261
2768341992919,7cyclictest2848190-21grep23:00:141
2768341992919,7cyclictest2783296-21grep19:50:221
2768341992919,6cyclictest0-21swapper/121:25:011
2768338992921,4cyclictest13550irq/42-30be0000.ethernet23:40:000
2768338992921,4cyclictest0-21swapper/022:35:250
2768349992821,3cyclictest0-21swapper/321:05:293
2768349992820,4cyclictest0-21swapper/322:45:273
2768349992820,4cyclictest0-21swapper/322:45:273
2768341992821,4cyclictest0-21swapper/119:30:181
276834199281,10cyclictest2781301-21cat19:45:151
2768338992822,3cyclictest0-21swapper/000:35:000
2768338992821,3cyclictest0-21swapper/022:45:270
2768338992821,3cyclictest0-21swapper/022:45:270
2768338992821,3cyclictest0-21swapper/022:00:010
2768338992821,3cyclictest0-21swapper/021:50:250
2768338992821,3cyclictest0-21swapper/021:25:000
2768338992820,5cyclictest0-21swapper/000:40:000
2768338992820,4cyclictest0-21swapper/020:15:250
2768338992818,6cyclictest0-21swapper/023:10:260
276833899281,6cyclictest2794665-21apt20:25:000
2768338992816,10cyclictest2846271-21/usr/sbin/munin22:55:160
2768349992720,5cyclictest2861456-21kworker/u8:1+events_unbound23:37:573
2768349992720,3cyclictest0-21swapper/320:10:233
2768349992719,4cyclictest0-21swapper/322:20:253
2768349992719,4cyclictest0-21swapper/300:35:173
2768349992717,6cyclictest0-21swapper/323:30:183
2768349992717,6cyclictest0-21swapper/321:30:163
276834999271,15cyclictest2836047-21/usr/sbin/munin22:25:183
2768341992717,7cyclictest2880572-21sh00:35:001
2768338992721,4cyclictest2833743-21kworker/u8:2+events_unbound22:42:510
2768338992721,4cyclictest2783838-21kworker/u8:0+events_unbound19:52:390
2768338992720,4cyclictest0-21swapper/023:30:010
2768338992719,4cyclictest0-21swapper/021:10:260
276833899271,19cyclictest0-21swapper/022:15:180
2768349992619,4cyclictest0-21swapper/319:30:273
2768349992618,5cyclictest0-21swapper/321:50:253
2768349992618,4cyclictest0-21swapper/322:40:263
2768349992618,4cyclictest0-21swapper/321:45:263
2768349992618,4cyclictest0-21swapper/319:25:283
276834199266,4cyclictest2789125-21unixbench_singl20:05:261
276834199266,4cyclictest2789125-21unixbench_singl20:05:261
2768341992620,4cyclictest2840701-21kworker/u8:0+events_unbound22:39:271
2768341992620,3cyclictest0-21swapper/123:20:251
2768341992619,5cyclictest2822130-21kworker/u8:1+events_unbound21:49:411
2768341992619,4cyclictest0-21swapper/121:30:231
2768341992619,4cyclictest0-21swapper/100:20:281
2768341992618,4cyclictest0-21swapper/121:00:251
2768338992620,3cyclictest0-21swapper/021:15:250
2768338992618,5cyclictest0-21swapper/021:45:280
2768338992616,6cyclictest2810006-21sh21:10:010
2768338992613,9cyclictest204-21dbus-daemon22:02:460
2768349992519,3cyclictest0-21swapper/319:45:013
2768349992518,3cyclictest0-21swapper/322:55:273
2768349992518,3cyclictest0-21swapper/319:40:013
2768349992517,6cyclictest0-21swapper/322:30:263
2768349992517,5cyclictest0-21swapper/323:40:253
2768349992517,5cyclictest0-21swapper/321:35:253
2768349992517,5cyclictest0-21swapper/320:00:173
2768349992517,4cyclictest0-21swapper/323:55:273
2768349992515,6cyclictest0-21swapper/320:25:273
276834199255,4cyclictest2874430-21meminfo00:15:191
2768341992519,3cyclictest0-21swapper/121:10:221
2768341992514,8cyclictest2841739-21ntp_states22:40:221
2768341992513,9cyclictest2854998-21sed23:20:011
276833899252,2cyclictest131rcu_preempt20:50:180
2768338992519,4cyclictest2806526-21kworker/u8:0+events_unbound21:00:270
2768338992519,3cyclictest2820485-21awk21:40:010
2768338992519,3cyclictest0-21swapper/021:25:250
2768338992517,4cyclictest0-21swapper/023:50:190
2768338992517,4cyclictest0-21swapper/019:17:010
2768338992514,7cyclictest204-21dbus-daemon20:07:380
2768338992514,7cyclictest204-21dbus-daemon20:07:380
276833899251,20cyclictest0-21swapper/019:44:580
2768349992416,5cyclictest2869924-21unixbench_singl00:00:293
2768349992416,5cyclictest0-21swapper/319:55:263
2768349992416,4cyclictest0-21swapper/323:22:553
276834999241,17cyclictest0-21swapper/321:01:193
2768341992418,4cyclictest2794500-21kworker/u8:2+events_unbound20:26:051
2768341992417,4cyclictest2834505-21fschecks_count22:20:151
2768341992417,4cyclictest0-21swapper/122:05:151
2768341992417,4cyclictest0-21swapper/119:25:181
2768341992417,3cyclictest0-21swapper/123:50:241
2768341992416,4cyclictest2825161-21grep21:50:251
2768341992414,6cyclictest2864758-21grep23:45:251
2768338992420,2cyclictest0-21swapper/020:40:560
2768338992418,3cyclictest0-21swapper/019:25:250
2768338992417,3cyclictest0-21swapper/022:24:510
2768338992417,3cyclictest0-21swapper/000:27:170
276833899241,19cyclictest0-21swapper/023:41:080
276833899241,19cyclictest0-21swapper/022:51:410
276833899241,19cyclictest0-21swapper/022:32:200
276833899241,19cyclictest0-21swapper/020:58:260
276833899240,20cyclictest0-21swapper/019:46:020
2768349992315,5cyclictest0-21swapper/300:15:253
2768349992314,6cyclictest0-21swapper/300:10:203
2768341992316,5cyclictest2869983-21kworker/u8:3+events_unbound00:01:401
276834199231,5cyclictest2815136-21apt-get21:25:041
2768341992315,4cyclictest0-21swapper/121:10:011
2768341992315,4cyclictest0-21swapper/120:40:161
2768341992314,7cyclictest2865002-21kworker/u8:1+events_unbound23:55:031
2768338992317,3cyclictest0-21swapper/023:45:110
2768338992316,3cyclictest0-21swapper/022:25:170
2768338992316,3cyclictest0-21swapper/022:11:360
2768338992316,3cyclictest0-21swapper/020:33:420
276833899231,3cyclictest0-21swapper/000:20:130
276834999225,8cyclictest131rcu_preempt00:25:183
276834999221,13cyclictest2825806-21/usr/sbin/munin21:55:283
276834199224,4cyclictest131rcu_preempt23:10:001
2768341992216,4cyclictest231ktimers/122:45:151
2768341992216,4cyclictest231ktimers/122:45:141
2768338992214,5cyclictest121ktimers/020:10:190
276833899221,3cyclictest0-21swapper/020:49:430
2768349992115,3cyclictest0-21swapper/319:45:153
2768349992114,4cyclictest2797645-21head20:30:263
276834999211,13cyclictest2857306-21/usr/sbin/munin23:25:223
276834999211,11cyclictest0-21swapper/320:40:233
2768341992115,3cyclictest0-21swapper/123:40:161
2768341992115,3cyclictest0-21swapper/122:50:241
2768341992115,3cyclictest0-21swapper/120:55:271
2768341992115,3cyclictest0-21swapper/120:50:151
2768341992114,4cyclictest2789488-21kworker/u8:0+events_unbound20:22:411
2768341992114,4cyclictest2768167-21kworker/u8:3+events_unbound19:10:241
2768341992014,4cyclictest231ktimers/122:25:131
276834199181,7cyclictest2797060-21missed_timers20:30:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional