You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 05:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Mon Mar 23, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22831639919950,1991cyclictest27147232sleep300:10:013
22831639919640,1958cyclictest24200122sleep320:54:573
22831639919160,1912cyclictest23630592sleep320:10:013
22831639916971,1691cyclictest2569262-21sleep22:35:003
22831639916370,1632cyclictest2592183-21sleep22:50:003
2283163993021,296cyclictest2439115-21turbostat21:14:553
2283163992114,5cyclictest2323277-21sleep19:40:003
228316399187,7cyclictest26623482sleep323:35:173
228316399187,7cyclictest26623482sleep323:35:173
23295422171,5sleep02329627-21gnome-shell19:41:160
228316399173,11cyclictest0-21swapper/319:41:183
25848932161,7sleep12584977-21grep22:45:131
232944999160,7rtkit-daemon1-21systemd19:41:271
228316399166,7cyclictest2523311-21sleep22:09:553
2283163991615,0cyclictest0-21swapper/323:56:103
2283163991613,1cyclictest0-21swapper/321:56:003
2283163991613,1cyclictest0-21swapper/321:54:263
2283163991613,1cyclictest0-21swapper/320:45:163
2283163991613,1cyclictest0-21swapper/320:18:523
2283163991612,1cyclictest0-21swapper/300:00:463
228316399161,12cyclictest2475323-21taskset21:30:223
228316399161,12cyclictest2394662-21turbostat20:39:553
228316399161,12cyclictest2283327-21taskset19:10:023
228316399161,11cyclictest2614027-21taskset23:01:483
228316399161,11cyclictest2349208-21taskset19:55:233
228316399161,11cyclictest2297886-21turbostat19:20:003
25160292151,4sleep12516024-21apt-get22:00:131
228316399156,7cyclictest2394660-21turbostat20:35:003
228316399155,7cyclictest26225372sleep323:09:303
228316399155,7cyclictest2499513-21taskset21:47:183
228316399155,7cyclictest2356249-21taskset20:02:113
228316399154,8cyclictest2337102-21taskset19:46:073
228316399154,8cyclictest2337102-21taskset19:46:073
2283163991512,1cyclictest0-21swapper/323:53:103
2283163991512,1cyclictest0-21swapper/323:45:223
2283163991512,1cyclictest0-21swapper/321:42:473
2283163991512,1cyclictest0-21swapper/321:42:473
2283163991512,1cyclictest0-21swapper/321:25:243
2283163991512,1cyclictest0-21swapper/300:36:053
228316399151,11cyclictest2743010-21taskset00:25:263
228316399151,11cyclictest2659745-21taskset23:31:313
228316399151,11cyclictest2645354-21taskset23:23:573
228316399151,11cyclictest2607121-21taskset22:58:583
228316399151,11cyclictest2599849-21taskset22:55:013
228316399151,11cyclictest2554067-21taskset22:25:013
228316399151,11cyclictest2545847-21taskset22:18:353
228316399151,11cyclictest2538208-21taskset22:13:433
228316399151,11cyclictest2485327-21taskset21:40:003
228316399151,11cyclictest2432996-21taskset21:05:033
228316399151,11cyclictest2316892-21taskset19:34:363
228316399151,11cyclictest2310262-21taskset19:25:543
228316399151,10cyclictest2730105-21chrt00:20:123
228316399151,10cyclictest2646717-21taskset23:25:183
228316399151,10cyclictest2357135-21taskset20:05:163
24779482141,5sleep02478149-21hddtemp_smartct21:35:130
228316399141,9cyclictest2426654-21taskset21:00:023
228316399141,9cyclictest2375790-21taskset20:20:133
2283163991412,0cyclictest0-21swapper/322:37:283
2283163991412,0cyclictest0-21swapper/300:16:363
228316399141,11cyclictest2622978-21taskset23:10:013
2283163991411,1cyclictest0-21swapper/320:42:363
228316399141,10cyclictest2707282-21taskset00:05:123
228316399141,10cyclictest2675043-21taskset23:41:293
228316399141,10cyclictest2583568-21taskset22:42:013
228316399141,10cyclictest2560287-21taskset22:26:013
228316399141,10cyclictest2523102-21taskset22:04:233
228316399141,10cyclictest2461195-21taskset21:22:203
228316399141,10cyclictest2453464-21taskset21:17:063
228316399141,10cyclictest2425700-21taskset20:55:253
228316399141,10cyclictest2387997-21taskset20:26:333
228316399141,10cyclictest2343389-21taskset19:50:283
228316399141,10cyclictest2303949-21taskset19:21:133
228316399131,10cyclictest2745603-21chrt00:30:153
228316399130,10cyclictest2636638-21chrt23:15:553
6471120,5low-memory-moni2330011-21xdg-desktop-por19:41:192
27535312121,8sleep12753012-21/usr/sbin/munin00:35:191
27124212121,3sleep02712453-21ntpq00:05:220
24624002121,8sleep10-21swapper/121:25:111
22827652120,2sleep30-21swapper/319:06:343
26903282110,4sleep12690334-21ssh23:51:231
26205742112,5sleep02620617-21ntpq23:05:220
25652802110,2sleep20-21swapper/222:30:182
25288652111,6sleep12528918-21ntpq22:05:221
25066822111,7sleep12506686-21ssh21:50:541
24858492110,8sleep22485990-21sed21:40:172
24858492110,8sleep22485990-21sed21:40:172
27162922100,3sleep22717905-21kthreadcore00:10:172
26994832101,5sleep02699518-21apt-get00:00:120
26980832101,6sleep12439096-21diskmemload23:56:491
26910082101,2sleep20-21swapper/223:53:332
26309002100,7sleep02631058-21gltestperf23:15:120
26230672101,5sleep02623063-21apt-get23:10:110
26216532100,4sleep22621659-21ssh23:06:522
25927332101,6sleep22592934-21iwlist22:50:162
25155772100,3sleep12515583-21ssh21:59:491
25059602101,5sleep22506006-21ntpq21:50:232
24532632100,7sleep22453267-21ssh21:16:342
24253932101,5sleep22425443-21ntpq20:55:212
24139332101,5sleep12414078-21df20:50:141
24063462101,5sleep22406390-21ntpq20:40:212
23172312101,5sleep02317387-21diskstats19:35:140
22770182101,4sleep10-21swapper/119:05:121
2758209291,4sleep22758252-21ntpq00:35:242
2727633291,5sleep12727686-21ntp_states00:15:221
2722404291,4sleep02722558-21df00:15:130
2705362290,6sleep22705366-21ssh00:00:482
2691841291,4sleep22691838-21apt-get23:55:132
2683098290,6sleep22439096-21diskmemload23:47:432
2653651291,4sleep12653646-21apt-get23:30:131
2645477290,3sleep02645483-21ssh23:24:190
2608459291,2sleep1171rcu_preempt23:00:171
2583065291,5sleep20-21swapper/222:40:292
2561227290,1sleep00-21swapper/022:28:560
2551854291,5sleep02551897-21ntpq22:20:210
2499093291,5sleep22499099-21ssh21:46:072
2497081291,5sleep02498130-21memory21:45:200
2470050291,4sleep12470087-21apt-get21:30:131
2468709291,6sleep22468705-21ssh21:26:582
2420282291,4sleep12420315-21apt-get20:55:121
2368183291,5sleep22368220-21ntpq20:10:212
2350423291,4sleep02350426-21apt-get20:00:130
2331179291,4sleep02331175-21apt-get19:45:130
2331179291,4sleep02331175-21apt-get19:45:130
2290733290,6sleep12291541-21grep19:15:021
2759290281,5sleep02439096-21diskmemload00:36:580
2750394280,4sleep02750540-21ntpq00:30:210
2699523281,3sleep10-21swapper/100:00:131
2691470280,6sleep02691475-21sh23:54:520
2660119281,4sleep00-21swapper/023:32:410
2651900280,1sleep20-21swapper/223:25:492
2630688281,3sleep12630725-21apt-get23:15:101
2613923280,1sleep20-21swapper/223:01:312
2613750286,1sleep0429-21hwrng23:00:520
2607436280,5sleep02607699-21latency_hist23:00:000
2605370281,4sleep12605421-21ntpq22:55:201
2568283281,4sleep072-21kcompactd022:32:130
2546573281,4sleep12546578-21diskmemload22:20:021
2545039280,6sleep02545044-21sh22:16:120
2513517281,4sleep02513563-21ntpq21:55:230
2501205280,5sleep02502196-21irqstats21:50:170
2499810280,3sleep12499816-21ssh21:48:181
2486954281,4sleep02488568-21ssh21:40:200
2486954281,4sleep02488568-21ssh21:40:190
2478150280,5sleep12478502-21sed21:35:141
2476927281,2sleep20-21swapper/221:33:312
2470256281,4sleep02470416-21/usr/sbin/munin21:30:160
2468628280,1sleep00-21swapper/021:26:430
2454812280,5sleep12454870-21ls21:20:141
2447122281,3sleep02447116-21apt-get21:15:130
2433044281,3sleep12433041-21apt-get21:05:141
2420016280,4sleep22420035-21dump-pmu-power20:55:012
2412715281,3sleep22412759-21ntpq20:45:222
2356935281,4sleep22357134-21hddtemp_smartct20:05:162
2355537280,4sleep22355581-21ntpq20:00:232
2349295280,4sleep12349418-21python319:55:251
2342859281,4sleep12342901-21ntpq19:50:231
2303318281,4sleep12303358-21ntpq19:20:241
2288774280,5sleep02289015-21unixbench_singl19:10:280
2283031281,4sleep02283102-21munin-run19:10:000
2745000270,4sleep02745056-21munin-run00:30:010
2697031270,4sleep02697086-21ntp_states23:55:230
2667775270,1sleep20-21swapper/223:37:372
2667775270,1sleep20-21swapper/223:37:362
2666538271,4sleep10-21swapper/123:35:231
2666538271,4sleep10-21swapper/123:35:231
2663419270,4sleep02665257-21cut23:35:180
2663419270,4sleep02665257-21cut23:35:180
2647599270,5sleep02649362-21cut23:25:190
2645340271,2sleep10-21swapper/123:23:561
2643416270,4sleep22643560-21ntpq23:20:202
2617601270,5sleep12618521-21kthreadcore23:05:191
2600088270,4sleep22600125-21apt-get22:55:092
2576235271,4sleep20-21swapper/222:38:002
2569896271,3sleep12570053-21cut22:35:141
2563494270,4sleep12565279-21cut22:30:171
2554331271,3sleep22554334-21apt-get22:25:132
2550488271,3sleep22551669-21ssh22:20:192
2531464270,4sleep12531668-21hddtemp_smartct22:10:161
2525009271,3sleep02525111-21kthreadcore22:05:170
2523592270,4sleep22523629-21apt-get22:05:112
2513611270,3sleep22513694-21ps21:55:252
2490689271,4sleep10-21swapper/121:40:241
2490689271,4sleep10-21swapper/121:40:241
2485087270,5sleep22485111-21latency_hist21:40:002
2454711271,3sleep22454715-21ssh21:20:032
2454022270,1sleep10-21swapper/121:18:501
2444594270,4sleep22444639-21ntpq21:10:202
2426667271,2sleep00-21swapper/021:00:120
2401238271,3sleep10-21swapper/120:40:121
2394937270,4sleep02395093-21diskstats20:35:140
2389005271,3sleep12389992-21irqstats20:30:171
2381851274,1sleep20-21swapper/220:25:012
2374527270,4sleep22374569-21ntpq20:15:232
2369401270,3sleep02369423-21apt-get20:15:130
2368312270,1sleep10-21swapper/120:10:251
2362806270,3sleep12362834-21basename20:10:001
2357325271,3sleep02358327-21kthreadcore20:05:180
2338018271,3sleep22338164-21sed19:50:162
2332603271,4sleep12334073-21kthreadcore19:45:191
2332603271,4sleep12334073-21kthreadcore19:45:181
2305963270,5sleep22307216-21cut19:25:182
2277054271,3sleep22277057-21cpu19:05:132
2751913261,2sleep10-21swapper/100:32:461
2751275260,4sleep22751281-21ssh00:30:512
2737040260,3sleep22737046-21ssh00:24:052
2736222260,1sleep00-21swapper/000:21:380
2735958261,2sleep10-21swapper/100:20:471
2721596260,1sleep00-21swapper/000:13:400
2720705260,1sleep10-21swapper/100:10:481
2707110261,2sleep10-21swapper/100:05:111
2676550260,3sleep12676556-21ssh23:45:131
2675769260,1sleep10-21swapper/123:43:411
2675536260,3sleep22675542-21ssh23:43:022
2659837260,3sleep22659843-21ssh23:31:472
2651627260,4sleep12646009-21/usr/sbin/munin23:25:281
2637062260,4sleep22637068-21ssh23:17:072
2628971260,3sleep22628975-21ssh23:10:452
2592409260,1sleep10-21swapper/122:50:031
2586727261,2sleep22588496-21kthreadcore22:45:182
2584881261,2sleep00-21swapper/022:45:120
2583967260,3sleep12583971-21ssh22:43:171
2575888260,1sleep00-21swapper/022:36:580
2561544260,3sleep12561546-21ssh22:29:541
2546180260,1sleep10-21swapper/122:19:421
2539154260,3sleep22539179-21fschecks_count22:15:142
2537328260,4sleep20-21swapper/222:11:012
2516318260,3sleep02439096-21diskmemload22:00:170
2454476260,3sleep02454514-21appstreamcli21:20:010
2443811260,4sleep02444480-21sed21:10:180
2439078260,1sleep00-21swapper/021:09:580
2431930260,4sleep22432052-21/usr/sbin/munin21:00:272
2426034260,1sleep00-21swapper/020:55:350
2419807260,1sleep00-21swapper/020:52:180
2399840260,3sleep22399920-21grep20:35:202
2395094260,3sleep12395256-21cut20:35:161
2394470260,1sleep00-21swapper/020:32:570
2381510262,2sleep02317002-21kworker/0:2+kacpid20:20:380
2369426261,2sleep10-21swapper/120:15:141
2351586261,3sleep12352700-21kthreadcore20:00:181
2349165260,4sleep22349207-21collect219:55:222
2343451260,1sleep00-21swapper/019:51:150
2334074260,3sleep22336079-21cut19:45:192
2334074260,3sleep22336079-21cut19:45:192
2317191261,2sleep20-21swapper/219:35:132
2317185260,1sleep10-21swapper/119:35:071
2316009260,4sleep12316057-21gcc19:30:221
2304182260,1sleep00-21swapper/019:24:160
2303365260,3sleep22303402-21ntpq19:20:252
2294397261,2sleep20-21swapper/219:15:192
2744243250,2sleep10-21swapper/100:27:451
2743591250,2sleep22743596-21sh00:25:452
2728606250,3sleep20-21swapper/200:16:392
2712312250,2sleep20-21swapper/200:05:202
2683211250,1sleep00-21swapper/023:48:090
2624385250,2sleep12624703-21ssh23:10:161
2593803250,2sleep00-21swapper/022:50:180
2578728250,2sleep00-21swapper/022:40:190
2532891250,2sleep02534648-21cut22:10:190
2522343251,2sleep22439096-21diskmemload22:02:062
2445747250,3sleep10-21swapper/121:12:001
2438897250,1sleep20-21swapper/221:07:402
2407613251,2sleep10-21swapper/120:45:131
2407160250,1sleep00-21swapper/020:43:040
2389993251,2sleep2421rcuc/220:30:182
2383449251,2sleep00-21swapper/020:25:190
2348705250,2sleep02349108-21strings19:55:200
2316924250,2sleep20-21swapper/219:35:002
2310886251,2sleep00-21swapper/019:30:130
2304542251,1sleep10-21swapper/119:25:131
2291816250,2sleep00-21swapper/019:15:130
2283341250,2sleep20-21swapper/219:10:142
2674146240,1sleep00-21swapper/023:40:230
2407578240,1sleep00-21swapper/020:45:120
2384525240,1sleep10-21swapper/120:25:201
2375959240,2sleep12376159-21smartctl20:20:151
2375755240,1sleep20-21swapper/220:20:122
2363071240,2sleep00-21swapper/020:10:110
2283538240,1sleep10-21swapper/119:10:181
2427530230,1sleep10-21swapper/121:00:171
2304506230,1sleep00-21swapper/019:25:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional