You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 09:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sun Jul 26, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2310660994934,11cyclictest121ktimers/020:35:150
2310666994718,10cyclictest2376882-21/usr/sbin/munin22:20:171
2310660994738,6cyclictest2338449-21unixbench_multi20:25:260
2310673994618,6cyclictest2310841-21sort19:10:013
2310666994519,9cyclictest2415159-21/usr/sbin/munin00:10:151
2310666994518,11cyclictest2379283-21which22:25:241
2310669994437,4cyclictest2390501-21sendmail23:00:012
2310666994434,6cyclictest2326944-21cron19:55:001
2310666994434,5cyclictest0-21swapper/100:39:311
2310666994316,9cyclictest2341171-21irqstats20:35:191
2310669994232,6cyclictest2325667-21fschecks_time19:50:152
2310666994228,10cyclictest2398533-21/usr/sbin/munin23:20:201
2310673994132,4cyclictest0-21swapper/321:25:003
2310666994133,5cyclictest2388163-21sed22:50:261
2310666994114,9cyclictest2395576-21chrt23:12:171
2310660994132,5cyclictest2425303-21idleruntime-cro00:39:590
2310666994032,3cyclictest2358332-21fschecks_time21:25:161
2310666994026,8cyclictest2320121-21cron19:35:001
2310666994023,11cyclictest0-21swapper/100:20:131
2310669993931,4cyclictest0-21swapper/220:00:012
2310666993928,7cyclictest2337874-21/usr/sbin/munin20:25:201
2310666993927,8cyclictest2408732-21/usr/sbin/munin23:50:201
2310660993932,4cyclictest2332087-21idleruntime-cro20:10:000
2310673993831,4cyclictest0-21swapper/320:50:003
2310666993829,4cyclictest0-21swapper/122:45:291
2310666993828,7cyclictest2389921-21/usr/sbin/munin22:55:241
2310666993827,7cyclictest2361963-21/usr/sbin/munin21:35:201
2310666993826,8cyclictest2351286-21/usr/sbin/munin21:05:121
2310666993825,7cyclictest2381987-21apt-get22:35:121
2310666993825,7cyclictest2381987-21apt-get22:35:121
2310660993829,6cyclictest0-21swapper/000:14:590
231066099381,4cyclictest131rcu_preempt20:10:140
2310673993730,4cyclictest2321841-21munin-plugin-st19:40:003
2310669993729,4cyclictest2411393-21sendmail00:00:002
2310669993726,7cyclictest2419918-21sh00:25:002
2310666993727,7cyclictest2336183-21/usr/sbin/munin20:20:201
2310666993727,7cyclictest2333384-21/usr/sbin/munin20:10:281
2310666993726,7cyclictest2422696-21/usr/sbin/munin00:30:241
2310666993726,7cyclictest2365281-21/usr/sbin/munin21:45:201
2310666993726,7cyclictest2317629-21/usr/sbin/munin19:25:231
2310666993725,9cyclictest2349072-21cron20:57:011
2310666993725,9cyclictest2315799-21/usr/sbin/munin19:20:231
2310666993725,7cyclictest2331141-21/usr/sbin/munin20:05:231
2310666993724,9cyclictest2403390-21/usr/sbin/munin23:35:191
2310666993721,11cyclictest2400160-21/usr/sbin/munin23:25:181
2310660993729,5cyclictest2314807-21grep19:20:010
2310660993729,4cyclictest0-21swapper/019:36:590
2310673993626,7cyclictest2367624-21grep21:50:263
2310669993627,4cyclictest0-21swapper/223:25:242
2310669993625,6cyclictest0-21swapper/222:40:012
2310669993625,6cyclictest0-21swapper/222:40:012
2310666993630,3cyclictest2392649-21apt-get23:05:141
2310666993626,7cyclictest2421700-21sshd00:28:291
2310666993626,7cyclictest2376285-21cron22:16:011
2310666993626,7cyclictest2370590-21/usr/sbin/munin22:00:201
2310666993626,7cyclictest2350064-21/usr/sbin/munin21:00:221
2310666993626,6cyclictest2368681-21/usr/sbin/munin21:55:181
2310666993626,5cyclictest0-21swapper/119:47:001
2310666993625,8cyclictest2381661-21cron22:34:001
2310666993625,7cyclictest2353512-21/usr/sbin/munin21:10:201
2310666993625,7cyclictest2353512-21/usr/sbin/munin21:10:201
2310666993625,7cyclictest2320737-21/usr/sbin/munin19:35:201
2310666993624,9cyclictest2384465-21/usr/sbin/munin22:40:251
2310666993623,10cyclictest2344862-21/usr/sbin/munin20:45:231
2310666993621,10cyclictest2357418-21grep21:20:271
2310660993625,9cyclictest121ktimers/023:35:120
2310673993523,8cyclictest2335229-21sshd20:17:033
2310673993523,8cyclictest2335229-21sshd20:17:033
2310669993528,3cyclictest0-21swapper/200:20:002
2310666993526,6cyclictest2314305-21/usr/sbin/munin19:15:251
2310666993526,5cyclictest0-21swapper/121:30:171
2310666993525,7cyclictest2412396-21/usr/sbin/munin00:00:271
2310666993525,7cyclictest2412396-21/usr/sbin/munin00:00:271
2310666993525,7cyclictest2347003-21/usr/sbin/munin20:50:261
2310666993525,7cyclictest2334145-21/usr/sbin/munin20:15:161
2310666993525,7cyclictest2334145-21/usr/sbin/munin20:15:161
2310666993524,7cyclictest2366639-21/usr/sbin/munin21:50:131
2310666993523,8cyclictest2327744-21ntp_offset19:55:221
2310666993516,13cyclictest2414975-21wc00:10:001
2310660993524,8cyclictest2395343-21grep23:10:250
2310673993427,4cyclictest2342311-21munin-plugin-st20:40:023
2310673993425,4cyclictest0-21swapper/322:05:263
2310669993421,10cyclictest2317060-21cstates19:25:152
2310666993426,4cyclictest2322102-21apt-get19:40:261
2310666993424,7cyclictest2391505-21/usr/sbin/munin23:00:231
2310666993424,7cyclictest2371817-21/usr/sbin/munin22:05:151
2310666993424,7cyclictest2354998-21/usr/sbin/munin21:15:201
2310666993418,12cyclictest2374470-21grep22:10:251
2310666993418,11cyclictest2406584-21/usr/sbin/munin23:45:141
2310666993417,14cyclictest2406287-21awk23:45:001
2310666993414,15cyclictest2363342-21/usr/sbin/munin21:40:151
2310660993424,7cyclictest2400674-21grep23:25:230
2310660993417,14cyclictest11-21ksoftirqd/023:05:130
2310669993322,7cyclictest0-21swapper/200:29:592
2310666993325,4cyclictest2328906-21apt-get20:00:151
2310666993324,6cyclictest2416846-21/usr/sbin/munin00:15:161
2310666993323,7cyclictest2339243-21/usr/sbin/munin20:30:161
2310666993322,8cyclictest2410036-21/usr/sbin/munin23:55:171
2310660993323,6cyclictest0-21swapper/022:45:190
2310673993224,4cyclictest0-21swapper/319:40:393
2310673993224,4cyclictest0-21swapper/300:35:003
2310669993225,4cyclictest0-21swapper/221:20:262
2310669993223,5cyclictest0-21swapper/200:34:592
2310666993223,6cyclictest2401706-21/usr/sbin/munin23:30:181
2310666993222,7cyclictest2343760-21cron20:42:001
2310660993226,3cyclictest0-21swapper/022:05:280
2310660993224,6cyclictest2388577-21latency_hist22:55:020
2310660993222,8cyclictest121ktimers/023:15:150
2310660993222,6cyclictest2409244-21grep23:50:260
2310673993123,4cyclictest0-21swapper/322:20:003
2310673993121,7cyclictest391ktimers/321:00:133
2310673993121,7cyclictest2411760-21fschecks_count00:00:173
2310673993121,7cyclictest2411760-21fschecks_count00:00:173
2310669993123,4cyclictest0-21swapper/221:05:232
2310669993121,6cyclictest0-21swapper/219:20:252
2310660993124,5cyclictest2321606-21kworker/u8:2+events_unbound19:47:010
2310660993123,4cyclictest0-21swapper/021:55:260
2310660993120,8cyclictest0-21swapper/023:35:000
2310673993022,4cyclictest0-21swapper/323:45:283
2310673993020,7cyclictest2356186-21sendmail21:20:003
2310673993020,7cyclictest0-21swapper/300:40:003
2310673993019,6cyclictest0-21swapper/319:30:253
2310669993022,4cyclictest0-21swapper/223:02:222
2310669993021,4cyclictest0-21swapper/223:15:272
2310669993020,6cyclictest2362530-21grep21:35:282
2310669993019,7cyclictest2319718-21grep19:30:262
2310669993018,8cyclictest0-21swapper/222:44:592
2310669993015,12cyclictest2310648-21cyclictest23:35:122
2310660993024,3cyclictest0-21swapper/022:25:270
2310660993020,7cyclictest2423075-21grep00:30:270
2310660993020,7cyclictest0-21swapper/020:35:010
2310660993020,6cyclictest0-21swapper/022:15:270
2310673992921,5cyclictest0-21swapper/322:55:013
2310673992921,4cyclictest0-21swapper/320:30:173
2310673992921,4cyclictest0-21swapper/300:20:153
2310673992919,7cyclictest2397742-21idleruntime-cro23:20:013
2310673992919,6cyclictest0-21swapper/322:00:263
2310673992919,6cyclictest0-21swapper/320:40:273
2310673992918,6cyclictest0-21swapper/319:50:253
2310669992922,3cyclictest0-21swapper/221:45:272
2310669992921,4cyclictest0-21swapper/223:50:272
2310669992920,5cyclictest2406282-21munin-plugin-st23:45:002
2310669992920,4cyclictest0-21swapper/221:50:262
2310660992922,4cyclictest0-21swapper/019:40:300
2310660992917,8cyclictest204-21dbus-daemon21:07:120
2310673992820,5cyclictest2310648-21cyclictest00:15:273
2310673992820,4cyclictest0-21swapper/323:00:003
2310673992820,4cyclictest0-21swapper/322:40:163
2310673992818,6cyclictest0-21swapper/322:00:003
2310660992822,4cyclictest2419667-21kworker/u8:1+events_unbound00:27:290
231066099281,4cyclictest131rcu_preempt23:40:130
231066099281,4cyclictest131rcu_preempt19:20:130
2310673992720,4cyclictest2378833-21idleruntime22:25:183
2310673992720,4cyclictest2318442-21idleruntime-cro19:30:023
2310673992719,4cyclictest0-21swapper/320:50:173
2310673992717,6cyclictest1-21systemd19:57:013
2310669992720,3cyclictest0-21swapper/220:30:262
2310669992720,3cyclictest0-21swapper/200:05:282
2310669992719,4cyclictest0-21swapper/223:20:252
2310669992718,6cyclictest2342309-21sendmail20:40:012
2310669992718,5cyclictest0-21swapper/200:15:002
2310669992716,6cyclictest0-21swapper/222:25:262
2310660992721,3cyclictest0-21swapper/023:25:000
2310660992720,3cyclictest0-21swapper/021:00:000
2310660992718,6cyclictest2361703-21grep21:35:170
231066099271,6cyclictest2383816-21df_inode22:40:150
231066099271,22cyclictest2356549-21/usr/sbin/munin21:20:170
2310673992619,4cyclictest0-21swapper/322:20:263
2310669992619,5cyclictest2386350-21timerwakeupswit22:45:282
2310669992619,3cyclictest0-21swapper/222:05:292
2310669992618,4cyclictest0-21swapper/220:05:272
2310669992615,6cyclictest0-21swapper/220:15:272
2310669992615,6cyclictest0-21swapper/220:15:272
2310669992613,10cyclictest311ktimers/200:00:132
2310669992613,10cyclictest311ktimers/200:00:132
2310660992618,4cyclictest0-21swapper/000:05:290
2310660992614,10cyclictest11-21ksoftirqd/000:15:140
2310673992518,4cyclictest0-21swapper/319:25:013
2310673992517,5cyclictest0-21swapper/323:05:003
2310673992516,6cyclictest2352751-21sh21:10:013
2310673992515,6cyclictest2421368-21grep00:25:263
2310673992514,7cyclictest2312070-21grep19:10:263
2310673992514,7cyclictest0-21swapper/323:40:003
2310669992518,4cyclictest2402897-21latency_hist23:35:012
2310669992518,4cyclictest0-21swapper/222:20:012
2310669992518,4cyclictest0-21swapper/219:40:012
2310669992518,3cyclictest0-21swapper/221:00:262
2310669992518,3cyclictest0-21swapper/219:10:262
2310669992517,5cyclictest0-21swapper/222:55:002
2310669992517,5cyclictest0-21swapper/221:00:002
2310669992517,4cyclictest0-21swapper/222:00:252
2310669992514,7cyclictest0-21swapper/221:15:192
2310660992519,3cyclictest0-21swapper/022:30:290
2310660992517,5cyclictest2390068-21unixbench_singl22:55:250
2310660992517,4cyclictest0-21swapper/000:25:000
2310660992516,5cyclictest2359111-21grep21:25:260
2310673992419,3cyclictest0-21swapper/322:30:253
2310673992418,3cyclictest0-21swapper/323:10:133
231067399241,7cyclictest24001922cat23:25:183
2310673992417,3cyclictest0-21swapper/322:10:153
2310673992417,3cyclictest0-21swapper/321:25:213
2310673992415,5cyclictest2314805-21munin-run19:20:003
2310673992414,6cyclictest1-21systemd20:27:043
2310669992418,3cyclictest2377886-21unixbench_multi22:20:262
2310669992418,3cyclictest0-21swapper/223:05:262
2310669992418,3cyclictest0-21swapper/221:30:252
2310669992418,3cyclictest0-21swapper/220:45:272
2310669992417,3cyclictest0-21swapper/220:45:002
2310669992417,3cyclictest0-21swapper/220:25:182
2310669992415,6cyclictest2425283-21cat00:40:002
231066099242,6cyclictest2347645-21grep20:55:000
2310660992419,2cyclictest0-21swapper/020:40:100
2310660992418,3cyclictest0-21swapper/021:05:010
2310660992417,5cyclictest2349095-21kworker/u8:1+events_unbound21:17:130
2310660992417,4cyclictest2312015-21grep19:10:250
2310660992417,4cyclictest0-21swapper/021:50:000
2310660992417,3cyclictest0-21swapper/020:02:460
2310660992413,8cyclictest2344454-21cut20:45:160
231066099241,19cyclictest0-21swapper/019:58:210
2310673992317,4cyclictest2332838-21ntpq20:10:213
2310673992317,3cyclictest0-21swapper/323:40:263
2310669992317,3cyclictest0-21swapper/221:55:222
2310669992317,2cyclictest0-21swapper/219:15:232
2310669992316,3cyclictest0-21swapper/223:45:272
2310669992316,3cyclictest0-21swapper/221:40:222
2310669992314,6cyclictest0-21swapper/222:15:012
2310660992316,3cyclictest0-21swapper/022:00:170
2310660992315,6cyclictest2378459-21ls22:25:000
2310660992315,6cyclictest121ktimers/019:50:180
2310660992313,7cyclictest2353519-21ntpq21:10:200
2310660992313,7cyclictest2353519-21ntpq21:10:200
2310660992313,6cyclictest0-21swapper/020:15:280
2310660992313,6cyclictest0-21swapper/020:15:280
231066099231,20cyclictest0-21swapper/023:00:140
231066099231,19cyclictest2383489-21idleruntime-cro22:40:000
231066099231,19cyclictest2383489-21idleruntime-cro22:40:000
231066099231,18cyclictest0-21swapper/022:10:300
2310673992216,3cyclictest2336764-21grep20:20:263
2310673992216,3cyclictest0-21swapper/323:30:233
2310673992216,3cyclictest0-21swapper/321:35:013
2310673992214,5cyclictest0-21swapper/320:55:263
2310673992213,6cyclictest0-21swapper/323:59:593
2310669992217,3cyclictest0-21swapper/221:15:012
2310669992217,3cyclictest0-21swapper/221:15:012
2310669992216,3cyclictest0-21swapper/223:10:192
2310669992216,3cyclictest0-21swapper/219:45:012
2310669992214,5cyclictest0-21swapper/220:55:012
2310669992214,4cyclictest0-21swapper/221:30:002
2310669992214,3cyclictest0-21swapper/220:25:012
2310660992218,2cyclictest13550irq/42-30be0000.ethernet20:20:220
2310660992217,3cyclictest2367339-21mailstats21:50:240
2310660992217,3cyclictest0-21swapper/023:47:030
2310660992217,3cyclictest0-21swapper/019:30:230
2310660992216,3cyclictest0-21swapper/019:25:200
2310660992215,4cyclictest13550irq/42-30be0000.ethernet21:43:280
2310660992214,4cyclictest2360029-21fschecks_time21:30:180
231066099221,17cyclictest0-21swapper/000:03:170
231066099221,17cyclictest0-21swapper/000:03:160
2310673992115,3cyclictest0-21swapper/320:05:173
2310673992114,5cyclictest164-21systemd-journal19:48:413
2310673992113,4cyclictest0-21swapper/323:05:263
2310673992112,6cyclictest2416707-21sed00:15:013
2310673992112,6cyclictest0-21swapper/323:50:263
2310669992115,3cyclictest0-21swapper/222:30:272
2310669992115,3cyclictest0-21swapper/219:45:222
2310669992111,7cyclictest2329849-21wc20:00:282
2310673992015,3cyclictest0-21swapper/323:20:213
2310673992013,4cyclictest391ktimers/321:10:143
2310673992013,4cyclictest391ktimers/321:10:133
2310673992013,4cyclictest2364711-21latency_hist21:45:013
2310673992011,4cyclictest438-21cron21:40:013
2310673992010,6cyclictest2365473-21/usr/sbin/munin21:45:223
2310669992014,3cyclictest2332469-21fschecks_count20:10:172
2310673991911,6cyclictest2413685-21tr00:05:223
231067399180,16cyclictest391ktimers/322:45:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional