You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-30 - 19:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Sat Aug 30, 2025 00:44:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16520199285413,2837cyclictest257522-21kworker/2:0+events00:00:182
16520199285113,2835cyclictest189277-21kworker/2:2+events20:25:122
16520199283214,2814cyclictest181144-21kworker/2:0+events20:05:182
16520999280713,2788cyclictest200956-21kworker/3:1+events21:00:173
16519599278913,2772cyclictest241508-21kworker/0:0+events23:55:190
16520199277613,2759cyclictest226436-21kworker/2:1+events22:26:552
16519599277313,2757cyclictest250947-21kworker/0:1+events23:35:130
16519599273713,2720cyclictest195696-21kworker/0:2+events20:45:200
16519799272013,2703cyclictest249444-21kworker/1:0+events23:50:201
1652099926779,2663cyclictest246315-21kworker/3:2+events23:20:183
16519599265713,2641cyclictest204013-21kworker/0:0+events21:12:520
16520999263213,2615cyclictest204227-21kworker/3:2+events21:29:583
16519799262013,2603cyclictest212072-21kworker/1:2+events21:44:381
16519799262013,2603cyclictest212072-21kworker/1:2+events21:44:381
1651959926097,2596cyclictest195696-21kworker/0:2+events20:50:100
16520999257912,2564cyclictest204227-21kworker/3:2+events21:23:523
16520999257812,2563cyclictest186108-21kworker/3:1+events20:23:383
16519799256312,2546cyclictest192542-21kworker/1:0+events21:10:131
16519799255410,2539cyclictest220043-21kworker/1:2+events22:00:141
16520199254912,2533cyclictest229722-21kworker/2:2+events22:30:182
1652019925484,2541cyclictest241550-21kworker/2:2+events23:10:492
16520199254312,2528cyclictest173338-21kworker/2:1+events19:35:172
16520999253812,2523cyclictest246315-21kworker/3:2+events23:34:263
16520199253610,2522cyclictest195786-21kworker/2:2+events20:50:352
16520199253512,2519cyclictest231341-21kworker/2:0+events22:39:052
16520199253412,2518cyclictest202490-21kworker/2:2+events21:15:572
16520199253412,2518cyclictest200800-21kworker/2:1+events20:58:282
16520199253312,2519cyclictest215312-21kworker/2:2+events21:57:102
16520199253112,2515cyclictest233084-21kworker/2:1+events22:54:282
16520199253012,2514cyclictest215312-21kworker/2:2+events22:07:522
16520999252411,2509cyclictest251471-21kworker/3:1+events23:38:173
16520199251812,2502cyclictest244494-21kworker/2:0+events23:27:092
16519599251813,2501cyclictest226749-21kworker/0:2+events22:25:210
16520999251012,2494cyclictest216779-21kworker/3:2+events21:52:583
16519599249712,2482cyclictest262225-21kworker/0:0+events00:15:000
16519599249210,2478cyclictest215036-21kworker/0:1+events22:08:370
16520199249111,2477cyclictest231341-21kworker/2:0+events22:57:102
16520999248212,2467cyclictest223523-21kworker/3:0+events22:36:473
16520999248112,2465cyclictest223523-21kworker/3:0+events22:44:203
16520999248012,2464cyclictest225125-21kworker/3:2+events22:23:033
16520999247710,2463cyclictest243107-21kworker/3:0+events23:11:343
16519799247712,2461cyclictest234435-21kworker/1:2+events23:30:121
16519599247712,2462cyclictest226749-21kworker/0:2+events22:57:550
1651959924739,2461cyclictest205628-21kworker/0:2+events21:26:570
16519599247211,2457cyclictest268488-21kworker/0:1+events00:26:490
16519799247112,2457cyclictest178162-21kworker/1:0+events19:55:021
16519599247011,2455cyclictest195696-21kworker/0:2+events21:02:590
16520199246912,2453cyclictest191038-21kworker/2:1+events20:38:532
16519799246911,2454cyclictest192542-21kworker/1:0+events21:04:061
16519599246912,2453cyclictest184391-21kworker/0:0+events20:08:410
16519599246510,2452cyclictest226749-21kworker/0:2+events22:40:150
16519599246412,2448cyclictest241508-21kworker/0:0+events23:44:350
16520199246212,2446cyclictest182850-21kworker/2:1+events20:18:162
16519799246212,2446cyclictest215343-21kworker/1:1+events21:54:521
16520199246112,2447cyclictest213650-21kworker/2:0+events21:40:052
16520199246112,2447cyclictest213650-21kworker/2:0+events21:40:052
16519799246112,2446cyclictest192542-21kworker/1:0+events21:15:121
16520199246010,2447cyclictest207064-21kworker/2:0+events21:21:382
16519799245911,2444cyclictest184244-21kworker/1:1+events20:28:591
16520999245812,2443cyclictest220281-21kworker/3:1+events22:13:573
16520199245812,2442cyclictest247836-21kworker/2:1+events23:48:022
16520199245710,2444cyclictest182850-21kworker/2:1+events20:10:352
1652099924559,2443cyclictest186108-21kworker/3:1+events20:17:513
16520199245312,2436cyclictest216927-21kworker/2:1+events21:50:192
16520199245211,2437cyclictest247836-21kworker/2:1+events23:51:052
16520199245211,2437cyclictest198810-21kworker/2:0+events21:06:002
16519599245211,2437cyclictest195696-21kworker/0:2+events20:57:000
16520199245111,2436cyclictest257522-21kworker/2:0+events23:55:422
16520199245012,2435cyclictest261899-21kworker/2:1+events00:11:152
16520199245012,2435cyclictest215312-21kworker/2:2+events22:01:192
16520999244812,2433cyclictest176434-21kworker/3:1+events19:43:593
16520199244812,2433cyclictest233084-21kworker/2:1+events23:07:262
16519799244712,2432cyclictest223328-21kworker/1:0+events22:07:281
1652019924469,2434cyclictest223610-21kworker/2:0+events22:10:552
16520199244611,2432cyclictest171615-21kworker/2:0+events19:42:072
16520199244512,2430cyclictest204104-21kworker/2:1+events21:10:382
16519799244511,2432cyclictest237926-21kworker/1:0+events23:05:081
16520999244412,2429cyclictest202602-21kworker/3:0+events21:08:203
16520999244410,2431cyclictest197190-21kworker/3:0+events20:55:293
16520199244411,2429cyclictest252473-21kworker/2:2+events23:37:062
16519799244312,2427cyclictest226532-21kworker/1:2+events22:24:111
16520999244212,2426cyclictest204227-21kworker/3:2+events21:11:013
16520999244111,2426cyclictest179662-21kworker/3:0+events20:14:273
16520999244012,2424cyclictest258894-21kworker/3:2+events23:58:223
16520999244012,2424cyclictest254057-21kworker/3:2+events23:44:583
16519599243910,2425cyclictest208879-21kworker/0:1+events21:32:580
16520999243812,2422cyclictest166023-21kworker/3:2+events19:18:433
16520999243712,2422cyclictest234444-21kworker/3:2+events22:45:273
16520999243712,2422cyclictest179662-21kworker/3:0+events20:07:123
1652099924369,2424cyclictest173164-21kworker/3:1+events19:35:403
16520999243612,2421cyclictest262245-21kworker/3:2+events00:08:363
16520999243612,2420cyclictest216779-21kworker/3:2+events21:48:043
16520999243511,2421cyclictest220281-21kworker/3:1+events22:08:143
16520999243412,2419cyclictest239584-21kworker/3:2+events23:05:323
16520999243312,2418cyclictest223523-21kworker/3:0+events22:34:543
16519799243112,2415cyclictest249444-21kworker/1:0+events23:47:151
16520999243012,2414cyclictest267134-21kworker/3:1+events00:27:103
16519799243012,2414cyclictest184244-21kworker/1:1+events20:36:361
16519599242811,2413cyclictest241508-21kworker/0:0+events23:08:100
16520999242510,2412cyclictest267134-21kworker/3:1+events00:32:083
16520999242111,2406cyclictest257272-21kworker/3:0+events23:53:473
16519599242112,2407cyclictest173395-21kworker/0:2+events19:45:320
16519599242012,2405cyclictest190703-21kworker/0:0+events20:37:460
16519799241712,2401cyclictest234435-21kworker/1:2+events23:11:121
16519799241512,2401cyclictest234435-21kworker/1:2+events22:50:421
16520999240810,2394cyclictest210290-21kworker/3:0+events21:30:213
16520199240712,2392cyclictest208731-21kworker/2:1+events21:34:482
16520999240612,2391cyclictest213528-21kworker/3:0+events21:41:133
16520999240612,2391cyclictest213528-21kworker/3:0+events21:41:123
1652019924069,2394cyclictest168487-21kworker/2:2+events19:27:292
16519599240412,2388cyclictest179438-21kworker/0:1+events19:53:070
16520999240312,2388cyclictest192200-21kworker/3:1+events20:32:043
16519599240312,2387cyclictest220146-21kworker/0:0+events21:57:570
16519799240112,2386cyclictest176407-21kworker/1:2+events19:44:211
16519799240112,2385cyclictest251266-21kworker/1:1+events23:43:501
16519599240112,2386cyclictest166370-21kworker/0:0+events19:28:570
16520199240012,2384cyclictest213650-21kworker/2:0+events21:47:192
16520999239912,2384cyclictest195581-21kworker/3:1+events20:44:573
16519599239712,2382cyclictest241508-21kworker/0:0+events23:34:020
16519599239611,2381cyclictest215036-21kworker/0:1+events22:14:200
16519599239512,2379cyclictest184391-21kworker/0:0+events20:18:390
16520999239412,2378cyclictest218391-21kworker/3:0+events21:55:153
16520199239312,2378cyclictest208731-21kworker/2:1+events21:26:102
16519599239312,2377cyclictest270186-21kworker/0:0+events00:32:530
16519599239311,2380cyclictest195696-21kworker/0:2+events21:05:370
16519599239311,2378cyclictest186077-21kworker/0:1+events20:27:040
16519599239112,2376cyclictest226749-21kworker/0:2+events22:23:470
16519599239012,2376cyclictest186077-21kworker/0:1+events20:30:070
16520999238910,2375cyclictest263877-21kworker/3:0+events00:18:003
16520999238910,2375cyclictest263877-21kworker/3:0+events00:18:003
16519599238912,2374cyclictest205628-21kworker/0:2+events21:20:520
16519799238812,2372cyclictest228205-21kworker/1:0+events22:33:211
16519599238812,2373cyclictest256054-21kworker/0:2+events00:02:580
16519599238712,2371cyclictest226749-21kworker/0:2+events22:37:070
16519599238712,2371cyclictest205628-21kworker/0:2+events21:16:220
16519599238612,2371cyclictest184391-21kworker/0:0+events20:14:040
16519599238612,2370cyclictest173395-21kworker/0:2+events20:02:150
16519599238611,2372cyclictest262225-21kworker/0:0+events00:16:320
16519599238611,2372cyclictest262225-21kworker/0:0+events00:16:320
16520199238511,2372cyclictest231341-21kworker/2:0+events23:00:142
16519799238511,2371cyclictest192542-21kworker/1:0+events20:43:041
16519599238511,2371cyclictest166370-21kworker/0:0+events19:33:010
16519599238511,2370cyclictest186077-21kworker/0:1+events20:23:140
16519599238510,2373cyclictest215036-21kworker/0:1+events22:03:370
16519799238412,2370cyclictest212072-21kworker/1:2+events21:35:091
16519799238412,2368cyclictest259356-21kworker/1:3+events00:12:001
16519799238410,2370cyclictest259356-21kworker/1:3+events00:04:261
16520999237911,2365cyclictest234444-21kworker/3:2+events22:50:193
16520999237910,2365cyclictest179662-21kworker/3:0+events19:58:493
16519799237712,2361cyclictest257236-21kworker/1:2+events00:09:001
16519799237512,2360cyclictest215343-21kworker/1:1+events22:15:291
16519799237412,2360cyclictest228205-21kworker/1:0+events22:40:561
16519599237312,2357cyclictest241508-21kworker/0:0+events23:27:300
16519799237212,2356cyclictest206059-21kworker/1:2+events21:24:161
16519799237112,2356cyclictest226532-21kworker/1:2+events22:28:241
16519799237012,2354cyclictest166776-21kworker/1:1+events19:22:541
16519799236612,2350cyclictest179778-21kworker/1:2+events20:04:321
16519799236412,2349cyclictest210405-21kworker/1:0+events21:28:261
16519799236312,2347cyclictest246131-21kworker/1:0+events23:21:041
16519799236311,2349cyclictest234435-21kworker/1:2+events22:56:461
16519799236012,2345cyclictest192542-21kworker/1:0+events21:05:141
16519799236012,2344cyclictest234435-21kworker/1:2+events23:27:531
16519799236011,2345cyclictest192542-21kworker/1:0+events20:52:021
16519799235511,2341cyclictest234435-21kworker/1:2+events22:49:121
1651979923543,2347cyclictest189337-21kworker/1:2+events20:33:131
16519799234211,2327cyclictest244524-21kworker/1:1+events23:15:421
16519799233610,2322cyclictest234435-21kworker/1:2+events23:04:001
16519799233312,2318cyclictest257236-21kworker/1:2+events23:56:521
16519599232211,2307cyclictest170091-21kworker/0:2+events19:24:040
16520999231612,2301cyclictest189350-21kworker/3:0+events20:28:383
16519799230210,2289cyclictest265444-21kworker/1:0+events00:28:441
16519599229812,2283cyclictest215036-21kworker/0:1+events22:19:400
16520199228611,2272cyclictest261899-21kworker/2:1+events00:09:462
16519599228611,2271cyclictest166370-21kworker/0:0+events19:39:510
16519599228311,2268cyclictest226749-21kworker/0:2+events23:01:210
1652099922828,2271cyclictest246315-21kworker/3:2+events23:29:493
16520199227910,2266cyclictest263748-21kworker/2:2+events00:15:222
16520199227910,2266cyclictest263748-21kworker/2:2+events00:15:212
16519799227511,2261cyclictest265444-21kworker/1:0+events00:38:111
1652099922676,2257cyclictest168267-21kworker/3:0+events19:47:443
16519799226611,2252cyclictest166776-21kworker/1:1+events19:25:371
16520199226211,2248cyclictest271707-21kworker/2:2+events00:36:412
16520999225910,2246cyclictest223523-21kworker/3:0+events22:19:173
16520199225512,2239cyclictest164723-21kworker/2:1+events19:18:222
16519599225511,2241cyclictest181055-21kworker/0:0+events19:56:580
16519599224610,2232cyclictest210491-21kworker/0:0+events21:37:270
16519799224410,2230cyclictest176407-21kworker/1:2+events19:46:131
1651979922438,2231cyclictest198931-21kworker/1:2+events20:56:151
1652099922409,2228cyclictest218391-21kworker/3:0+events22:00:343
1652019922339,2220cyclictest171615-21kworker/2:0+events19:34:102
16520199223310,2219cyclictest241550-21kworker/2:2+events23:15:202
16520199223210,2219cyclictest267242-21kworker/2:2+events00:26:012
1652099922309,2217cyclictest265486-21kworker/3:2+events00:24:283
1652099922309,2217cyclictest265486-21kworker/3:2+events00:24:283
16520199222911,2215cyclictest247836-21kworker/2:1+events23:32:302
16520999222811,2213cyclictest255675-21kworker/3:1+events23:47:393
1652019922288,2217cyclictest171615-21kworker/2:0+events19:45:522
16520999222711,2213cyclictest260645-21kworker/3:0+events00:03:443
16520999222711,2213cyclictest223523-21kworker/3:0+events22:28:003
16520199222711,2213cyclictest191038-21kworker/2:1+events20:31:402
16520199222710,2214cyclictest182850-21kworker/2:1+events20:04:092
16520199222611,2212cyclictest244494-21kworker/2:0+events23:22:362
16520199222611,2211cyclictest200800-21kworker/2:1+events21:01:052
16519799222610,2213cyclictest215343-21kworker/1:1+events21:55:381
16520199222511,2210cyclictest179531-21kworker/2:1+events19:56:352
16519599222510,2211cyclictest241508-21kworker/0:0+events23:53:000
16520999222410,2210cyclictest195581-21kworker/3:1+events20:48:203
16520199222411,2209cyclictest261899-21kworker/2:1+events00:21:232
16520199222411,2209cyclictest261899-21kworker/2:1+events00:21:232
16520199222410,2210cyclictest231341-21kworker/2:0+events22:42:502
16520999222310,2209cyclictest193874-21kworker/3:2+events20:37:223
16520199222310,2210cyclictest187165-21kworker/2:0+events20:24:022
16520999222210,2209cyclictest204227-21kworker/3:2+events21:16:443
1651979922229,2210cyclictest223328-21kworker/1:0+events22:11:421
1652019922209,2206cyclictest247836-21kworker/2:1+events23:41:152
1652019922199,2206cyclictest265504-21kworker/2:0+events00:30:382
1652019922192,2213cyclictest176367-21kworker/2:2+events19:54:162
16520999221410,2201cyclictest197190-21kworker/3:0+events20:53:573
16520999221410,2201cyclictest176434-21kworker/3:1+events19:50:253
16520999221311,2199cyclictest239584-21kworker/3:2+events22:59:063
16520999221310,2200cyclictest204227-21kworker/3:2+events21:39:443
16520999220910,2196cyclictest268776-21kworker/3:0+events00:37:503
16520999220910,2195cyclictest169903-21kworker/3:1+events19:25:133
1652099922068,2195cyclictest171509-21kworker/3:2+events19:30:273
16520999220510,2192cyclictest179662-21kworker/3:0+events20:04:553
1652099922049,2191cyclictest168267-21kworker/3:0+events19:21:013
16520999220311,2189cyclictest237714-21kworker/3:0+events23:01:433
16519799220310,2190cyclictest173094-21kworker/1:2+events19:34:331
16519599219711,2183cyclictest226749-21kworker/0:2+events23:19:330
16519599219510,2182cyclictest193934-21kworker/0:1+events20:44:350
16519599219411,2180cyclictest247682-21kworker/0:1+events23:23:440
16519599219311,2179cyclictest173395-21kworker/0:2+events19:41:200
16519799219210,2179cyclictest187694-21kworker/1:0+events20:22:541
16520199218711,2172cyclictest191038-21kworker/2:1+events20:49:062
16519599218711,2173cyclictest216665-21kworker/0:0+events21:49:120
1651959921869,2174cyclictest168456-21kworker/0:1+events19:19:050
1651959921867,2176cyclictest215036-21kworker/0:1+events21:51:270
16519799218411,2170cyclictest192542-21kworker/1:0+events20:46:501
16519599218411,2170cyclictest254368-21kworker/0:1+events23:49:120
16519599218411,2170cyclictest234684-21kworker/0:1+events22:48:270
16519599218311,2168cyclictest271829-21kworker/0:2+events00:38:350
16520199218211,2168cyclictest215312-21kworker/2:2+events22:15:532
16519599218111,2167cyclictest213400-21kworker/0:2+events21:40:510
16519599218111,2167cyclictest213400-21kworker/0:2+events21:40:510
16519599218010,2167cyclictest262225-21kworker/0:0+events00:24:060
16519599218010,2167cyclictest262225-21kworker/0:0+events00:24:060
16519599218010,2167cyclictest226749-21kworker/0:2+events22:31:510
16520999217810,2164cyclictest263877-21kworker/3:0+events00:13:053
16519799217511,2161cyclictest265444-21kworker/1:0+events00:19:521
16519799217511,2161cyclictest265444-21kworker/1:0+events00:19:521
16519799217211,2157cyclictest268751-21kworker/1:2+events00:33:381
16519799216610,2153cyclictest267080-21kworker/1:1+events00:23:421
16519799216610,2153cyclictest267080-21kworker/1:1+events00:23:421
16519599216610,2153cyclictest226749-21kworker/0:2+events23:13:480
16519799216311,2149cyclictest210405-21kworker/1:0+events21:32:371
16519599216211,2148cyclictest226749-21kworker/0:2+events22:54:060
1651979921618,2149cyclictest184244-21kworker/1:1+events20:08:191
16519799216011,2146cyclictest212072-21kworker/1:2+events21:48:501
16519799216011,2146cyclictest166776-21kworker/1:1+events19:17:361
16519799215711,2142cyclictest185888-21kworker/1:2+events20:12:541
1651979921559,2143cyclictest174775-21kworker/1:1+events19:37:561
16519799215411,2140cyclictest174775-21kworker/1:1+events19:52:431
16519799214111,2126cyclictest251266-21kworker/1:1+events23:37:541
16519799213611,2122cyclictest231439-21kworker/1:1+events22:37:311
1652019921247,2114cyclictest164723-21kworker/2:1+events19:21:452
1652019921168,2105cyclictest212014-21kworker/2:2+events21:37:022
1652019920967,2085cyclictest226436-21kworker/2:1+events22:21:312
1652019920929,2081cyclictest187165-21kworker/2:0+events20:40:022
16519799208810,2075cyclictest184244-21kworker/1:1+events20:19:251
16520999208510,2072cyclictest166023-21kworker/3:2+events19:14:563
16520999207010,2057cyclictest243107-21kworker/3:0+events23:18:453
16519599203410,2020cyclictest262225-21kworker/0:0+events00:07:500
1651959920247,2013cyclictest166370-21kworker/0:0+events19:12:390
1652019920129,2000cyclictest164723-21kworker/2:1+events19:10:462
16519799200010,1987cyclictest164942-21kworker/1:2+events19:14:101
1648722149103,26sleep00-21swapper/019:08:540
1646202146111,29sleep20-21swapper/219:05:492
164905214395,44sleep30-21swapper/319:09:213
1647122141109,26sleep10-21swapper/119:06:521
16520199143,5cyclictest235619-10ldconfig22:45:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional