You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 13:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Thu May 21, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2672287995749,5cyclictest438-21cron00:20:013
2672276995243,5cyclictest2740156-21taskset22:25:010
2672283995116,10cyclictest2700715-21fschecks_count20:30:152
2672280995041,5cyclictest2722308-21unixbench_singl21:30:311
2672287994833,11cyclictest391ktimers/300:20:113
2672283994613,15cyclictest2740801-21expr22:25:192
2672276994627,6cyclictest2696617-21kworker/u8:0+events_unbound20:28:420
2672283994536,5cyclictest2697494-21kernelversion20:20:192
2672283994513,15cyclictest2693315-21cat20:10:012
2672283994511,11cyclictest2727900-21ls21:50:012
2672287994432,8cyclictest2703734-21sendmail20:40:013
2672283994412,14cyclictest2677286-21cat19:20:252
2672280994428,12cyclictest231ktimers/121:50:111
2672280994428,12cyclictest231ktimers/121:50:111
2672283994332,7cyclictest204-21dbus-daemon20:00:172
2672280994334,5cyclictest2707126-21cron20:50:011
2672276994235,4cyclictest2683032-21cron19:40:010
2672276994232,6cyclictest121ktimers/022:55:120
2672287994134,4cyclictest2769385-21munin-plugin-st23:50:003
2672280994135,4cyclictest2668424-21kworker/u8:3+events_unbound20:00:171
2672276994129,8cyclictest2705028-21grep20:40:310
2672287994033,4cyclictest2784924-21cron00:35:003
2672283994014,10cyclictest27822102meminfo00:25:182
2672283994010,14cyclictest2723333-21latency21:35:222
2672287993931,4cyclictest0-21swapper/320:55:153
2672283993910,10cyclictest2747807-21ntp_states22:45:212
2672283993910,10cyclictest2704418-21meminfo20:40:242
267228799380,4cyclictest131rcu_preempt21:40:133
2672283993829,5cyclictest2738262-21sendmail22:20:012
2672283993812,9cyclictest2712366-21cut21:05:012
2672280993828,6cyclictest0-21swapper/123:50:261
2672276993832,4cyclictest2720635-21kworker/u8:3+events_unbound21:40:440
267227699380,9cyclictest11-21ksoftirqd/020:05:150
2672287993728,6cyclictest2781906-21fschecks_count00:25:143
2672287993726,8cyclictest2734852-21auditctl22:10:003
267228399379,10cyclictest2710030-21cat20:55:252
2672283993720,11cyclictest2759391-21apt-get23:20:112
2672283993720,11cyclictest0-21swapper/221:50:112
2672283993720,11cyclictest0-21swapper/221:50:112
2672283993717,12cyclictest0-21swapper/200:00:112
2672276993721,6cyclictest2710907-21kworker/u8:0+events_unbound00:39:130
267227699371,9cyclictest11-21ksoftirqd/000:05:120
267227699371,9cyclictest11-21ksoftirqd/000:05:120
2672283993624,9cyclictest2733495-21/usr/sbin/munin22:05:132
2672283993622,11cyclictest2765010-21/usr/sbin/munin23:35:202
2672283993618,13cyclictest2695549-21/usr/sbin/munin20:15:152
2672283993615,5cyclictest2754716-21memory23:05:192
2672280993628,4cyclictest0-21swapper/119:20:011
2672280993628,4cyclictest0-21swapper/119:20:001
2672280993626,6cyclictest0-21swapper/122:40:251
2672280993625,7cyclictest0-21swapper/120:25:251
2672280993625,7cyclictest0-21swapper/100:20:241
2672276993625,7cyclictest2767259-21grep23:40:240
2672276993619,6cyclictest2782316-21kworker/u8:3+events_unbound00:29:210
267227699361,8cyclictest11-21ksoftirqd/000:10:100
267227699361,8cyclictest11-21ksoftirqd/000:10:100
2672276993610,5cyclictest131rcu_preempt23:25:110
2672287993527,4cyclictest0-21swapper/322:55:563
2672287993527,4cyclictest0-21swapper/320:25:003
2672283993528,4cyclictest2769611-21apt-get23:50:122
2672283993523,9cyclictest2780062-21apt-get00:20:112
2672283993522,9cyclictest0-21swapper/221:05:152
2672283993522,10cyclictest2702587-21/usr/sbin/munin20:35:172
2672283993521,11cyclictest2694067-21/usr/sbin/munin20:10:182
2672283993521,11cyclictest2694067-21/usr/sbin/munin20:10:182
2672283993521,10cyclictest2776951-21/usr/sbin/munin00:10:182
2672283993521,10cyclictest2776951-21/usr/sbin/munin00:10:182
2672283993510,10cyclictest645-21runrttasks20:53:592
2672280993525,7cyclictest2724397-21sh21:40:011
2672280993525,6cyclictest0-21swapper/119:30:241
2672287993428,3cyclictest0-21swapper/322:25:003
2672287993426,3cyclictest0-21swapper/319:45:133
2672283993423,8cyclictest2783465-21apt-get00:30:122
2672283993423,7cyclictest2750050-21sshd22:50:552
2672283993423,7cyclictest2735082-21munin-node22:10:102
2672283993422,9cyclictest2714887-21/usr/sbin/munin21:10:222
2672283993422,9cyclictest2714887-21/usr/sbin/munin21:10:212
2672283993422,7cyclictest0-21swapper/221:20:262
2672283993422,6cyclictest311ktimers/219:35:132
2672283993421,8cyclictest2742636-21/usr/sbin/munin22:30:192
2672283993421,10cyclictest2750771-21/usr/sbin/munin22:55:142
2672283993413,6cyclictest2758009-21irqstats23:15:202
2672283993412,8cyclictest2739074-21ntpq22:20:212
2672280993426,4cyclictest2696475-21seq20:15:251
2672280993424,6cyclictest0-21swapper/122:00:241
2672280993423,7cyclictest0-21swapper/120:40:011
2672280993420,5cyclictest2682735-21kworker/u8:0+events_unbound20:05:181
2672276993429,3cyclictest0-21swapper/021:05:120
2672276993428,4cyclictest2710907-21kworker/u8:0+events_unbound00:33:370
2672276993426,5cyclictest2717597-21sendmail21:20:000
2672276993426,5cyclictest2717597-21sendmail21:20:000
2672287993325,4cyclictest0-21swapper/320:30:223
2672283993324,7cyclictest2687818-21cron19:51:012
2672283993324,5cyclictest0-21swapper/223:30:242
2672283993322,7cyclictest2746828-21cron22:43:002
2672283993322,7cyclictest2724648-21sshd21:40:102
2672283993321,9cyclictest2778685-21/usr/sbin/munin00:15:172
2672283993321,8cyclictest2683349-21/usr/sbin/munin19:40:142
2672283993320,10cyclictest2730486-21/usr/sbin/munin21:55:202
2672283993320,10cyclictest2730486-21/usr/sbin/munin21:55:192
2672283993320,10cyclictest2678167-21sshd19:25:102
2672280993326,4cyclictest0-21swapper/119:45:151
2672280993325,4cyclictest0-21swapper/122:55:161
2672280993323,6cyclictest0-21swapper/122:55:001
2672280993323,6cyclictest0-21swapper/122:50:001
2672280993322,7cyclictest0-21swapper/122:05:261
2672276993326,4cyclictest2772786-21munin-plugin-st00:00:010
2672276993324,4cyclictest0-21swapper/023:00:560
2672287993225,4cyclictest0-21swapper/321:40:013
2672287993218,11cyclictest2777416-21unixbench_multi00:10:233
2672287993218,11cyclictest2777416-21unixbench_multi00:10:233
2672283993226,3cyclictest2766211-21apt-get23:40:132
2672283993226,3cyclictest2743921-21df22:35:132
2672283993224,4cyclictest2721230-21apt-get21:30:102
2672283993224,4cyclictest2705667-21apt-get20:45:122
2672283993224,4cyclictest0-21swapper/223:10:262
2672283993222,7cyclictest2681256-21sshd19:34:112
2672283993222,6cyclictest0-21swapper/219:45:152
2672283993221,8cyclictest2716774-21/usr/sbin/munin21:15:242
2672283993221,8cyclictest2716774-21/usr/sbin/munin21:15:242
2672283993220,8cyclictest0-21swapper/219:15:242
2672283993220,8cyclictest0-21swapper/219:15:242
2672283993219,10cyclictest2774943-21/usr/sbin/munin00:05:162
2672283993219,10cyclictest2774943-21/usr/sbin/munin00:05:162
2672283993217,9cyclictest0-21swapper/221:25:102
2672280993223,6cyclictest0-21swapper/122:15:241
267227699322,7cyclictest11-21ksoftirqd/019:10:080
2672276993225,5cyclictest2774126-21kworker/u8:2+events_unbound00:03:170
2672276993225,4cyclictest2676223-21idleruntime-cro19:20:000
2672276993225,4cyclictest2676223-21idleruntime-cro19:20:000
2672276993225,4cyclictest0-21swapper/020:55:250
2672276993224,5cyclictest2695192-21idleruntime-cro20:15:010
2672276993224,5cyclictest2695192-21idleruntime-cro20:15:000
2672276993223,6cyclictest0-21swapper/022:30:010
267227699321,17cyclictest2771067-21cron23:55:000
267228799318,4cyclictest27499112timerwakeupswit22:50:243
2672287993125,4cyclictest2775883-21kworker/u8:1+events_unbound00:08:243
2672287993125,4cyclictest2775883-21kworker/u8:1+events_unbound00:08:243
2672287993124,4cyclictest0-21swapper/322:35:243
2672283993125,3cyclictest2785167-21apt-get00:35:132
2672283993121,7cyclictest2732026-21/usr/sbin/munin22:00:172
2672283993121,7cyclictest2672433-21munin-node19:10:082
2672283993120,7cyclictest2698900-21/usr/sbin/munin20:25:132
2672283993112,15cyclictest2688502-21sshd19:55:152
2672280993122,6cyclictest0-21swapper/121:10:011
2672280993122,6cyclictest0-21swapper/120:55:261
2672280993120,7cyclictest2759163-21sendmail23:20:001
267227699314,14cyclictest11-21ksoftirqd/021:25:110
2672276993125,4cyclictest2758987-21kworker/u8:3+events_unbound23:20:590
2672276993125,4cyclictest0-21swapper/020:35:120
2672276993124,4cyclictest2756181-21grep23:10:160
2672276993122,6cyclictest2731900-21fschecks_time22:00:150
2672287993024,4cyclictest2759685-21if_eth023:20:153
2672287993024,3cyclictest2765960-21kthreadd23:40:003
2672287993023,4cyclictest2674283-21runrttasks19:15:023
2672287993023,4cyclictest2674283-21runrttasks19:15:023
2672287993021,6cyclictest2683030-21sh19:40:013
2672287993017,9cyclictest0-21swapper/320:00:163
2672283993024,3cyclictest2752632-21if_err_eth123:00:162
2672283993020,7cyclictest2769116-21cron23:47:002
2672283993019,8cyclictest2762307-21cron23:27:002
2672280993023,4cyclictest0-21swapper/121:55:241
2672280993023,4cyclictest0-21swapper/121:55:241
2672280993022,4cyclictest0-21swapper/100:35:161
2672280993021,5cyclictest0-21swapper/119:35:161
2672280993020,6cyclictest0-21swapper/122:40:001
2672280993020,6cyclictest0-21swapper/119:55:261
2672280993020,6cyclictest0-21swapper/119:40:171
2672276993013,7cyclictest131rcu_preempt22:50:110
2672276993010,4cyclictest131rcu_preempt21:55:110
2672276993010,4cyclictest131rcu_preempt21:55:110
2672287992922,3cyclictest0-21swapper/319:50:223
2672287992921,4cyclictest0-21swapper/319:25:263
2672283992919,7cyclictest2772294-21unixbench_multi23:55:262
267228099298,14cyclictest24-21ksoftirqd/100:10:211
267228099298,14cyclictest24-21ksoftirqd/100:10:201
2672280992924,3cyclictest2677638-21kworker/u8:2+events_unbound19:25:091
2672280992922,4cyclictest2674093-21latency_hist19:15:011
2672280992922,4cyclictest0-21swapper/123:50:001
2672280992917,9cyclictest438-21cron00:35:001
267227699298,13cyclictest131rcu_preempt19:50:150
2672276992923,3cyclictest2779820-21cron00:20:010
2672276992921,4cyclictest0-21swapper/019:55:260
2672276992917,5cyclictest131rcu_preempt00:20:240
2672276992916,5cyclictest2693168-21kworker/u8:1+events_unbound20:52:480
2672276992914,6cyclictest2767307-21kworker/u8:3+events_unbound23:49:170
267227699291,19cyclictest131rcu_preempt21:15:000
267227699291,19cyclictest131rcu_preempt21:15:000
2672276992910,11cyclictest11-21ksoftirqd/023:35:010
2672287992821,5cyclictest2739893-21kworker/u8:2+events_unbound23:05:183
2672287992820,5cyclictest0-21swapper/322:20:013
2672287992818,6cyclictest0-21swapper/322:45:253
267228799281,5cyclictest131rcu_preempt22:25:133
2672287992812,5cyclictest2710907-21kworker/u8:0+events_unbound23:55:113
267228799281,14cyclictest0-21swapper/321:07:113
2672280992821,4cyclictest0-21swapper/120:40:311
2672280992820,4cyclictest0-21swapper/122:30:531
2672280992819,5cyclictest0-21swapper/120:30:161
2672276992819,6cyclictest2765559-21grep23:35:250
2672276992814,5cyclictest2720635-21kworker/u8:3+events_unbound22:16:560
267228799273,3cyclictest131rcu_preempt23:25:123
2672287992721,3cyclictest0-21swapper/319:55:263
2672287992720,4cyclictest0-21swapper/322:05:003
2672287992719,5cyclictest0-21swapper/319:30:243
2672287992719,4cyclictest0-21swapper/321:45:443
2672287992718,6cyclictest0-21swapper/323:00:153
2672280992719,4cyclictest0-21swapper/123:35:151
267227699279,10cyclictest131rcu_preempt20:31:250
2672276992720,5cyclictest2710907-21kworker/u8:0+events_unbound21:02:130
2672276992720,5cyclictest2677638-21kworker/u8:2+events_unbound19:24:490
2672276992719,4cyclictest0-21swapper/022:05:270
2672287992620,4cyclictest2758987-21kworker/u8:3+events_unbound23:31:043
2672287992619,4cyclictest0-21swapper/322:30:153
2672287992619,4cyclictest0-21swapper/321:15:263
2672287992619,4cyclictest0-21swapper/321:15:263
2672287992619,4cyclictest0-21swapper/320:05:283
2672287992619,3cyclictest0-21swapper/321:25:223
2672287992618,4cyclictest0-21swapper/319:10:123
267228799260,4cyclictest0-21swapper/321:57:293
267228799260,4cyclictest0-21swapper/321:57:293
2672280992618,5cyclictest0-21swapper/123:25:251
2672280992617,5cyclictest2772810-21sendmail-msp00:00:001
2672280992616,7cyclictest0-21swapper/121:00:171
267227699266,12cyclictest11-21ksoftirqd/021:50:250
267227699266,12cyclictest11-21ksoftirqd/021:50:240
267227699262,5cyclictest2755259-21unixbench_multi23:05:250
267227699262,13cyclictest0-21swapper/019:27:040
267227699262,12cyclictest0-21swapper/019:31:220
2672276992620,4cyclictest2710907-21kworker/u8:0+events_unbound21:46:200
2672276992617,3cyclictest131rcu_preempt22:10:150
2672276992611,3cyclictest0-21swapper/022:48:210
267227699261,13cyclictest0-21swapper/022:36:500
267227699261,12cyclictest0-21swapper/022:42:350
2672276992610,5cyclictest131rcu_preempt19:45:240
267228799252,3cyclictest131rcu_preempt21:00:133
2672287992520,3cyclictest2708418-21unixbench_singl20:50:233
2672287992519,4cyclictest2693168-21kworker/u8:1+events_unbound20:12:103
2672287992519,4cyclictest2693168-21kworker/u8:1+events_unbound20:12:103
2672287992515,7cyclictest40-21ksoftirqd/323:10:213
2672280992517,5cyclictest0-21swapper/120:10:161
2672280992517,5cyclictest0-21swapper/120:10:151
2672280992517,4cyclictest0-21swapper/122:25:511
2672280992517,4cyclictest0-21swapper/121:45:011
2672280992515,6cyclictest2728023-21apt-key21:50:011
2672280992515,5cyclictest0-21swapper/123:00:151
2672280992514,8cyclictest2718861-21grep21:20:261
267227699259,9cyclictest131rcu_preempt20:00:160
267227699256,9cyclictest0-21swapper/020:49:250
267227699255,3cyclictest131rcu_preempt20:15:180
2672276992519,4cyclictest2720635-21kworker/u8:3+events_unbound21:34:280
267227699251,10cyclictest2759260-21cat23:20:010
2672287992418,4cyclictest2753454-21kworker/u8:1+events_unbound23:15:193
2672287992418,4cyclictest2720635-21kworker/u8:3+events_unbound21:34:403
2672287992418,3cyclictest0-21swapper/321:20:233
2672287992418,3cyclictest0-21swapper/321:10:173
2672287992418,3cyclictest0-21swapper/321:10:173
2672287992416,5cyclictest0-21swapper/322:10:263
2672287992416,4cyclictest2684951-21latency_hist19:45:023
2672287992414,6cyclictest2774490-21cron00:05:013
267228099246,5cyclictest24-21ksoftirqd/100:10:001
267228099246,5cyclictest24-21ksoftirqd/100:10:001
2672280992415,6cyclictest0-21swapper/123:05:241
2672280992415,6cyclictest0-21swapper/122:20:251
2672280992415,5cyclictest0-21swapper/119:50:201
267228099240,21cyclictest0-21swapper/100:00:121
267227699241,12cyclictest0-21swapper/021:39:350
267227699241,12cyclictest0-21swapper/019:40:240
267227699240,12cyclictest2697392-21/usr/sbin/munin20:20:170
2672287992317,3cyclictest0-21swapper/323:50:253
2672287992317,3cyclictest0-21swapper/320:25:133
2672287992315,5cyclictest0-21swapper/320:15:153
2672287992313,3cyclictest40-21ksoftirqd/319:20:253
2672280992316,4cyclictest2708063-21mailstats20:50:211
2672280992315,5cyclictest0-21swapper/121:25:241
2672280992315,5cyclictest0-21swapper/100:15:241
2672280992315,4cyclictest0-21swapper/123:10:261
2672280992314,5cyclictest0-21swapper/123:20:251
2672276992319,2cyclictest0-21swapper/022:34:270
2672287992216,3cyclictest2747003-21sh22:45:013
2672287992215,5cyclictest2710907-21kworker/u8:0+events_unbound21:52:373
2672287992215,5cyclictest2710907-21kworker/u8:0+events_unbound21:52:363
267228099221,5cyclictest131rcu_preempt21:10:141
267228099221,5cyclictest131rcu_preempt21:10:141
2672280992214,5cyclictest0-21swapper/119:20:261
2672280992214,5cyclictest0-21swapper/100:25:241
2672280992213,6cyclictest0-21swapper/121:20:021
2672280992213,6cyclictest0-21swapper/121:20:011
267228799214,5cyclictest131rcu_preempt20:40:133
267228799211,10cyclictest2767346-21sshd23:41:033
267228799206,3cyclictest0-21swapper/300:38:443
2672287992011,6cyclictest2705781-21seq20:45:143
2672280992013,4cyclictest0-21swapper/120:20:181
267228099201,12cyclictest0-21swapper/123:40:021
2672280991911,5cyclictest0-21swapper/122:10:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional