You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 16:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Sun May 10, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
51256899358418,3561cyclictest533770-21kworker/2:1+events20:30:002
51257199312415,3103cyclictest585208-21kworker/3:0+events23:10:173
51256899299814,2979cyclictest591808-21kworker/2:0+events23:55:122
51256399295813,2939cyclictest581974-21kworker/1:0+events22:45:131
51256399293814,2919cyclictest608933-21kworker/1:0+events00:15:171
51255899290414,2884cyclictest571096-21kworker/0:0+events22:10:170
51256399288014,2863cyclictest534018-21kworker/1:2+events20:15:141
51255899283713,2822cyclictest593419-21kworker/0:0+events23:35:130
51256899282913,2812cyclictest570887-21kworker/2:1+events22:15:162
51256399281113,2794cyclictest577576-21kworker/1:2+events22:40:001
51255899279113,2775cyclictest557907-21kworker/0:2+events21:31:240
51257199278814,2770cyclictest590647-21kworker/3:1+events23:40:113
51255899278812,2774cyclictest606264-21kworker/0:1+events00:05:010
51255899276913,2753cyclictest574365-21kworker/0:2+events22:24:270
51257199276513,2748cyclictest516090-21kworker/3:1+events19:20:173
51255899276513,2748cyclictest562439-21kworker/0:1+events21:52:010
51255899276112,2745cyclictest606264-21kworker/0:1+events00:11:500
51255899276110,2747cyclictest571096-21kworker/0:0+events22:17:070
51255899275112,2735cyclictest583753-21kworker/0:0+events22:50:120
51256399266812,2652cyclictest519683-21kworker/1:0+events19:31:201
51255899265313,2637cyclictest526021-21kworker/0:0+events19:50:010
51256899263312,2617cyclictest574092-21kworker/2:0+events22:20:122
51255899262113,2604cyclictest537161-21kworker/0:1+events20:29:370
51256899261513,2599cyclictest575753-21kworker/2:2+events22:33:112
51256399258211,2568cyclictest602989-21kworker/1:1+events23:46:381
51256899257212,2557cyclictest564594-21kworker/2:0+events21:50:302
51256899256812,2552cyclictest617942-21kworker/2:0+events00:37:182
51256899256512,2551cyclictest533770-21kworker/2:1+events20:45:322
51256899256312,2547cyclictest533770-21kworker/2:1+events20:24:152
51256899255611,2541cyclictest568746-21kworker/2:0+events22:03:522
51256899255512,2539cyclictest580061-21kworker/2:0+events22:37:252
51256899255512,2539cyclictest580061-21kworker/2:0+events22:37:252
51256899255111,2537cyclictest530528-21kworker/2:2+events20:11:282
51256899254912,2534cyclictest591808-21kworker/2:0+events23:28:442
51256899254912,2534cyclictest533770-21kworker/2:1+events20:52:402
51256899254712,2531cyclictest587025-21kworker/2:1+events23:13:002
51256899254710,2534cyclictest551065-21kworker/2:1+events21:25:212
5125689925469,2534cyclictest546414-21kworker/2:2+events21:06:262
51255899254212,2526cyclictest569495-21kworker/0:1+events22:06:100
51255899253812,2523cyclictest520930-21kworker/0:2+events19:36:420
5125589925339,2521cyclictest517598-21kworker/0:0+events19:40:320
51256399253212,2516cyclictest536869-21kworker/1:0+events20:48:121
51255899253212,2516cyclictest539961-21kworker/0:0+events20:36:490
51255899253210,2519cyclictest557907-21kworker/0:2+events21:44:430
5125589925318,2519cyclictest603019-21kworker/0:0+events23:49:150
51255899253110,2519cyclictest613371-21kworker/0:1+events00:25:080
51255899252912,2513cyclictest543212-21kworker/0:2+events20:57:350
51255899252911,2514cyclictest562439-21kworker/0:1+events21:56:350
51256399252813,2511cyclictest596852-21kworker/1:1+events23:30:591
51255899252810,2514cyclictest598819-21kworker/0:1+events23:42:260
51255899252612,2510cyclictest578782-21kworker/0:0+events22:37:010
51255899252612,2510cyclictest578782-21kworker/0:0+events22:37:010
51256899252412,2509cyclictest532140-21kworker/2:0+events20:17:272
51256399251111,2496cyclictest562616-21kworker/1:0+events22:01:591
51256899250212,2487cyclictest587025-21kworker/2:1+events23:08:202
51256899250212,2486cyclictest570887-21kworker/2:1+events22:12:122
51255899250010,2487cyclictest532230-21kworker/0:0+events20:13:210
51256899249412,2480cyclictest559257-21kworker/2:1+events21:45:062
51256899249412,2479cyclictest585293-21kworker/2:2+events22:57:442
51256899249312,2477cyclictest580061-21kworker/2:0+events22:42:172
5125689924929,2480cyclictest611206-21kworker/2:2+events00:32:452
51256899249212,2477cyclictest591808-21kworker/2:0+events23:36:222
51256899249212,2477cyclictest530528-21kworker/2:2+events20:07:192
51256899249212,2476cyclictest593403-21kworker/2:2+events23:22:362
51256899249211,2478cyclictest554438-21kworker/2:0+events21:17:232
51255899249212,2476cyclictest545019-21kworker/0:0+events20:51:130
51256899249110,2478cyclictest524271-21kworker/2:2+events19:48:082
51255899249112,2476cyclictest556277-21kworker/0:1+events21:28:030
51255899249112,2475cyclictest562439-21kworker/0:1+events21:48:120
51255899249110,2477cyclictest530469-21kworker/0:2+events20:05:450
51257199249012,2474cyclictest526509-21kworker/3:1+events20:18:143
51256899249012,2474cyclictest583599-21kworker/2:1+events22:52:072
51256899249011,2475cyclictest554438-21kworker/2:0+events21:31:012
51256399249011,2476cyclictest612781-21kworker/1:2+events00:20:381
51256899248712,2471cyclictest596761-21kworker/2:1+events23:32:092
51256899248711,2472cyclictest612872-21kworker/2:1+events00:17:582
51256899248612,2471cyclictest515933-21kworker/2:2+events19:27:552
51256899248612,2470cyclictest580061-21kworker/2:0+events22:45:362
51256899248612,2470cyclictest520902-21kworker/2:0+events19:35:552
51256899248610,2472cyclictest533770-21kworker/2:1+events20:43:162
5125639924866,2478cyclictest562616-21kworker/1:0+events21:45:531
51256899248511,2470cyclictest606416-21kworker/2:2+events00:04:162
51256899248312,2468cyclictest591808-21kworker/2:0+events00:06:322
51255899248312,2468cyclictest585482-21kworker/0:1+events23:23:230
51255899248311,2468cyclictest515906-21kworker/0:2+events19:16:490
51256399248212,2466cyclictest512217-21kworker/1:1+events19:24:531
51256899247912,2464cyclictest515933-21kworker/2:2+events19:21:272
51256899247910,2465cyclictest591808-21kworker/2:0+events23:50:212
51256399247912,2463cyclictest581974-21kworker/1:0+events23:05:411
51256399247812,2463cyclictest530709-21kworker/1:0+events20:10:231
51256399247712,2462cyclictest574156-21kworker/1:1+events22:19:031
51256399247711,2463cyclictest536869-21kworker/1:0+events20:41:211
5125639924757,2465cyclictest616041-21kworker/1:2+events00:36:541
51256399247512,2459cyclictest600090-21kworker/1:2+events23:42:501
51256899247311,2459cyclictest575753-21kworker/2:2+events22:29:252
5125639924739,2461cyclictest536869-21kworker/1:0+events21:03:451
5125639924739,2460cyclictest552906-21kworker/1:1+events21:27:401
51256899247212,2457cyclictest557641-21kworker/2:2+events21:35:342
51256399247112,2457cyclictest562616-21kworker/1:0+events21:55:041
51256899246912,2454cyclictest611206-21kworker/2:2+events00:14:312
51256899246812,2452cyclictest603171-21kworker/2:2+events23:48:542
51256899246712,2451cyclictest546414-21kworker/2:2+events21:00:162
51256899246712,2451cyclictest530528-21kworker/2:2+events20:03:252
51256399246612,2450cyclictest555406-21kworker/1:2+events21:21:331
51255899246312,2447cyclictest528840-21kworker/0:1+events20:03:030
51255899246112,2445cyclictest532230-21kworker/0:0+events20:17:060
51256399245912,2443cyclictest577576-21kworker/1:2+events22:39:161
51255899245810,2444cyclictest547859-21kworker/0:1+events21:13:380
51255899245611,2442cyclictest549554-21kworker/0:0+events21:03:220
51255899245411,2439cyclictest585482-21kworker/0:1+events23:07:110
51255899245312,2439cyclictest541590-21kworker/0:1+events20:45:100
51255899245211,2437cyclictest528840-21kworker/0:1+events19:58:510
51257199245111,2437cyclictest543124-21kworker/3:0+events20:41:453
51255899245112,2436cyclictest609875-21kworker/0:2+events00:18:440
51255899245111,2437cyclictest574365-21kworker/0:2+events22:25:360
5125589924499,2437cyclictest585482-21kworker/0:1+events22:55:520
51255899244912,2434cyclictest613371-21kworker/0:1+events00:22:520
51255899244911,2434cyclictest517598-21kworker/0:0+events19:27:300
51255899244811,2434cyclictest526021-21kworker/0:0+events19:50:450
51255899244712,2432cyclictest535430-21kworker/0:2+events20:33:030
51257199244611,2431cyclictest600154-21kworker/3:0+events00:01:113
51255899244612,2430cyclictest549554-21kworker/0:0+events21:07:340
51255899244611,2432cyclictest532230-21kworker/0:0+events20:23:540
51255899244512,2430cyclictest585482-21kworker/0:1+events23:02:200
51255899244510,2432cyclictest578782-21kworker/0:0+events22:33:570
51255899244412,2430cyclictest539961-21kworker/0:0+events20:40:340
51256399244312,2428cyclictest614415-21kworker/1:0+events00:29:401
51255899244312,2428cyclictest617791-21kworker/0:0+events00:34:580
51255899244312,2428cyclictest607948-21kworker/0:0+events00:03:510
5125639924409,2428cyclictest540169-21kworker/1:2+events20:36:021
51256399244011,2427cyclictest517836-21kworker/1:2+events19:28:411
51256399243011,2415cyclictest581974-21kworker/1:0+events22:56:151
51256399242812,2412cyclictest569317-21kworker/1:2+events22:07:181
51256399242411,2409cyclictest596852-21kworker/1:1+events23:38:131
5125639924217,2411cyclictest594986-21kworker/1:0+events23:28:201
51257199242012,2405cyclictest517778-21kworker/3:2+events19:40:543
51257199242011,2405cyclictest554469-21kworker/3:2+events21:16:593
51256399241612,2403cyclictest581974-21kworker/1:0+events22:44:301
51256399241012,2394cyclictest551305-21kworker/1:2+events21:10:151
51256399240712,2391cyclictest552906-21kworker/1:1+events21:15:301
51257199240411,2390cyclictest526509-21kworker/3:1+events20:06:073
51256399240211,2387cyclictest552906-21kworker/1:1+events21:33:381
5125639924019,2388cyclictest527446-21kworker/1:1+events20:07:421
51257199240011,2386cyclictest544848-21kworker/3:1+events20:57:123
51255899239710,2383cyclictest619419-21kworker/0:1+events00:38:280
51256399239611,2382cyclictest536869-21kworker/1:0+events20:55:391
51256399239512,2379cyclictest524152-21kworker/1:1+events19:42:241
51256399239512,2379cyclictest513928-21kworker/1:0+events19:17:121
51256399239510,2382cyclictest565793-21kworker/1:1+events21:52:251
51256399239510,2381cyclictest519683-21kworker/1:0+events19:39:461
51256399239312,2378cyclictest570916-21kworker/1:1+events22:11:021
51257199239114,2374cyclictest611358-21kworker/3:1+events00:19:073
51256399239112,2376cyclictest594986-21kworker/1:0+events23:23:471
51256399239112,2376cyclictest552906-21kworker/1:1+events21:35:571
51256399239112,2375cyclictest606207-21kworker/1:0+events23:57:501
51256399239112,2375cyclictest585235-21kworker/1:2+events22:54:201
51256399239111,2376cyclictest602989-21kworker/1:1+events23:51:291
51256399239111,2376cyclictest591653-21kworker/1:1+events23:19:541
51256399239110,2378cyclictest606562-21kworker/1:3+events00:05:241
51256399238912,2373cyclictest525786-21kworker/1:0+events19:53:041
51256399238812,2373cyclictest574156-21kworker/1:1+events22:28:391
51256399238812,2373cyclictest525786-21kworker/1:0+events19:57:171
51257199238712,2372cyclictest532263-21kworker/3:2+events20:12:153
51256399238612,2371cyclictest611175-21kworker/1:1+events00:11:281
51256399238611,2372cyclictest536869-21kworker/1:0+events20:27:401
51257199238412,2369cyclictest540257-21kworker/3:2+events20:50:493
51256399238412,2369cyclictest534018-21kworker/1:2+events20:23:301
5125589923849,2371cyclictest552729-21kworker/0:2+events21:21:110
51257199238312,2367cyclictest616552-21kworker/3:0+events00:37:413
51256399238312,2368cyclictest517836-21kworker/1:2+events19:47:001
51256399237812,2362cyclictest540169-21kworker/1:2+events20:34:331
51256899236811,2353cyclictest580061-21kworker/2:0+events23:01:102
51256399236612,2351cyclictest581974-21kworker/1:0+events23:02:421
51256899235911,2346cyclictest612872-21kworker/2:1+events00:25:512
5125719923516,2341cyclictest554469-21kworker/3:2+events21:30:173
51257199234212,2328cyclictest572637-21kworker/3:1+events22:30:313
51257199234212,2327cyclictest581941-21kworker/3:0+events22:43:003
51257199234112,2325cyclictest571038-21kworker/3:2+events22:15:373
51257199234111,2327cyclictest517778-21kworker/3:2+events19:39:223
51257199234012,2325cyclictest596912-21kworker/3:2+events23:30:373
51257199233912,2324cyclictest572637-21kworker/3:1+events22:58:073
51255899233912,2325cyclictest557907-21kworker/0:2+events21:36:210
51257199233812,2324cyclictest517778-21kworker/3:2+events19:50:233
51257199233812,2323cyclictest544848-21kworker/3:1+events20:49:403
51257199233812,2322cyclictest600154-21kworker/3:0+events23:56:183
51257199233811,2324cyclictest600154-21kworker/3:0+events23:47:453
51257199233810,2325cyclictest572637-21kworker/3:1+events22:35:533
51257199233810,2325cyclictest572637-21kworker/3:1+events22:35:533
51257199233712,2321cyclictest560873-21kworker/3:1+events21:43:113
51257199233612,2321cyclictest572637-21kworker/3:1+events22:49:053
51257199233612,2321cyclictest567060-21kworker/3:1+events21:59:413
51257199233612,2320cyclictest567060-21kworker/3:1+events22:05:463
51257199233611,2322cyclictest517778-21kworker/3:2+events19:55:223
51257199233412,2319cyclictest572637-21kworker/3:1+events22:25:143
51257199233111,2314cyclictest554469-21kworker/3:2+events21:27:173
51257199232512,2310cyclictest549760-21kworker/3:0+events21:10:383
51257199232511,2311cyclictest611358-21kworker/3:1+events00:28:553
51257199232412,2309cyclictest596912-21kworker/3:2+events23:29:533
51257199232412,2309cyclictest549760-21kworker/3:0+events21:09:073
51257199232311,2308cyclictest571038-21kworker/3:2+events22:11:493
51255899232010,2307cyclictest604671-21kworker/0:2+events23:53:460
51256899231611,2301cyclictest538685-21kworker/2:0+events20:32:162
51257199231412,2299cyclictest600154-21kworker/3:0+events23:52:373
51256399231210,2298cyclictest549674-21kworker/1:1+events21:06:491
51257199230911,2295cyclictest593204-21kworker/3:2+events23:16:293
51255899230012,2284cyclictest603019-21kworker/0:0+events23:55:330
51255899229712,2283cyclictest567869-21kworker/0:0+events22:00:040
51256399229211,2277cyclictest606562-21kworker/1:3+events00:01:571
51256899227311,2258cyclictest601448-21kworker/2:1+events23:43:112
51256899227311,2258cyclictest524271-21kworker/2:2+events19:43:342
51256899226811,2254cyclictest568746-21kworker/2:0+events22:06:542
51256899226811,2253cyclictest510670-21kworker/2:1+events19:16:022
51256899226711,2253cyclictest612872-21kworker/2:1+events00:21:452
51256899226510,2251cyclictest559257-21kworker/2:1+events21:42:492
51256899226510,2251cyclictest510670-21kworker/2:1+events19:12:562
5125689922649,2251cyclictest551065-21kworker/2:1+events21:20:472
51256899226410,2250cyclictest562707-21kworker/2:2+events21:59:182
51255899226312,2248cyclictest582037-21kworker/0:2+events22:49:270
51256899225910,2246cyclictest587025-21kworker/2:1+events23:17:152
51256899225910,2245cyclictest528899-21kworker/2:1+events19:59:352
51256899225711,2243cyclictest519262-21kworker/2:1+events19:33:412
51257199225412,2239cyclictest556128-21kworker/3:1+events21:23:293
51255899225011,2236cyclictest591715-21kworker/0:2+events23:14:570
51256399224911,2235cyclictest575784-21kworker/1:0+events22:30:551
51255899224911,2234cyclictest585482-21kworker/0:1+events23:18:230
51257199224812,2233cyclictest540257-21kworker/3:2+events20:37:553
5125589922358,2224cyclictest585482-21kworker/0:1+events23:25:400
51255899223110,2218cyclictest580385-21kworker/0:1+events22:44:500
51256399222810,2216cyclictest616041-21kworker/1:2+events00:30:261
51255899221911,2205cyclictest517598-21kworker/0:0+events19:23:210
5125589922139,2200cyclictest593419-21kworker/0:0+events23:33:420
51256399220210,2188cyclictest574156-21kworker/1:1+events22:23:411
51255899219811,2184cyclictest517598-21kworker/0:0+events19:34:030
51256399219710,2184cyclictest529055-21kworker/1:2+events20:01:301
51257199219111,2177cyclictest609607-21kworker/3:2+events00:08:273
5125589921912,2186cyclictest552729-21kworker/0:2+events21:17:460
51257199218211,2168cyclictest590647-21kworker/3:1+events23:24:103
51257199217812,2163cyclictest536961-21kworker/3:2+events20:24:393
51256399217811,2164cyclictest546351-21kworker/1:1+events20:54:331
51257199217710,2164cyclictest611358-21kworker/3:1+events00:14:083
51257199217111,2156cyclictest574274-21kworker/3:0+events22:20:353
5125639921697,2160cyclictest590050-21kworker/1:2+events23:11:031
51256399216711,2153cyclictest513928-21kworker/1:0+events19:14:551
51256399216710,2154cyclictest560794-21kworker/1:2+events21:43:551
51257199215511,2141cyclictest544848-21kworker/3:1+events21:01:033
51257199214311,2128cyclictest533884-21kworker/3:0+events20:33:243
5125719921407,2130cyclictest611358-21kworker/3:1+events00:22:303
51257199213811,2124cyclictest516090-21kworker/3:1+events19:27:083
5125719921378,2126cyclictest520748-21kworker/3:0+events19:34:483
51257199213710,2124cyclictest533884-21kworker/3:0+events20:28:503
5125719921305,2121cyclictest585208-21kworker/3:0+events23:04:113
51257199212911,2115cyclictest517778-21kworker/3:2+events19:47:453
51257199212811,2114cyclictest564459-21kworker/3:0+events21:51:393
51257199212611,2112cyclictest557732-21kworker/3:0+events21:37:073
51257199212210,2109cyclictest513663-21kworker/3:2+events19:15:173
51257199211711,2104cyclictest526509-21kworker/3:1+events20:02:403
5125589920109,1998cyclictest512565-21kworker/0:0+events19:14:310
5125719919759,1963cyclictest567060-21kworker/3:1+events22:01:143
51257199197310,1960cyclictest588484-21kworker/3:2+events23:06:273
51257199196410,1951cyclictest613025-21kworker/3:2+events00:31:133
51257199196210,1949cyclictest562558-21kworker/3:2+events21:48:593
5125719919227,1912cyclictest572637-21kworker/3:1+events22:52:533
5125719919079,1895cyclictest510700-21kworker/3:0+events19:11:463
5121842149104,26sleep10-21swapper/119:07:501
5122392143112,26sleep30-21swapper/319:08:333
5122362142111,26sleep00-21swapper/019:08:300
5122212142110,27sleep20-21swapper/219:08:202
512568992217,3cyclictest541895-21sendmail20:40:002
512568992117,3cyclictest865-10wireplumber21:15:012
51257199200,18cyclictest600212-21true23:40:003
51256899169,5cyclictest548083-21seq20:58:422
51256899154,7cyclictest526819-21ntpq19:50:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional