You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 12:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Mon Jul 20, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6994019936318,3617cyclictest785038-21kworker/1:0+events23:35:201
6994019928445,2833cyclictest717715-21kworker/1:0+events20:10:021
69939899281811,2803cyclictest732162-21kworker/0:2+events21:00:230
69940599281113,2794cyclictest762750-21kworker/2:0+events22:41:432
69940599280213,2785cyclictest716181-21kworker/2:1+events21:10:342
6993989927828,2771cyclictest743242-21kworker/0:2+events21:24:230
6993989927828,2771cyclictest743242-21kworker/0:2+events21:24:230
69940799277913,2762cyclictest748551-21kworker/3:1+events21:45:163
6993989927631,2758cyclictest796255-21kworker/0:0+events00:19:500
69940199276113,2745cyclictest748202-21kworker/1:1+events21:57:011
69940199273813,2721cyclictest768914-21kworker/1:1+events22:47:021
69940199273612,2722cyclictest749825-21kworker/1:2+events22:05:171
69940199273612,2720cyclictest721263-21kworker/1:2+events20:20:241
69940199273013,2714cyclictest733951-21kworker/1:0+events21:00:001
69940199272713,2711cyclictest748202-21kworker/1:1+events21:42:361
69940199272313,2706cyclictest724496-21kworker/1:1+events20:41:171
69940199271213,2695cyclictest756071-21kworker/1:0+events22:22:441
69940199269613,2679cyclictest714232-21kworker/1:1+events20:06:151
69939899268311,2668cyclictest732162-21kworker/0:2+events20:58:520
69939899267212,2656cyclictest765923-21kworker/0:0+events22:40:110
69939899267212,2656cyclictest709459-21kworker/0:0+events19:43:350
69940599266611,2652cyclictest704202-21kworker/2:1+events19:25:152
69940599266512,2649cyclictest796220-21kworker/2:2+events00:15:172
69940599266013,2643cyclictest716181-21kworker/2:1+events20:25:182
69940599264113,2624cyclictest716181-21kworker/2:1+events20:38:372
69940599263413,2616cyclictest700977-21kworker/2:3+events19:15:192
69940599259812,2583cyclictest747988-21kworker/2:2+events21:39:332
69939899259813,2581cyclictest732162-21kworker/0:2+events20:48:320
69940599259713,2580cyclictest762750-21kworker/2:0+events22:26:342
69940599258711,2572cyclictest762750-21kworker/2:0+events22:32:382
69939899258113,2564cyclictest779850-21kworker/0:1+events23:27:460
69939899257912,2563cyclictest775228-21kworker/0:2+events23:19:240
69939899257912,2563cyclictest771967-21kworker/0:2+events22:53:540
69939899257912,2563cyclictest743242-21kworker/0:2+events21:26:170
69940599257511,2562cyclictest712569-21kworker/2:2+events20:05:062
69939899257412,2559cyclictest764268-21kworker/0:1+events22:37:090
69939899257412,2559cyclictest699029-21kworker/0:1+events19:22:140
69940599257212,2556cyclictest716181-21kworker/2:1+events20:34:262
69939899257112,2555cyclictest752671-21kworker/0:0+events22:03:020
69940599257012,2554cyclictest712569-21kworker/2:2+events20:10:252
69939899256912,2555cyclictest761035-21kworker/0:2+events22:25:020
69939899256712,2551cyclictest724557-21kworker/0:0+events20:42:260
69939899256711,2553cyclictest773598-21kworker/0:1+events23:05:210
69939899256612,2551cyclictest784947-21kworker/0:0+events23:55:520
69939899256611,2551cyclictest716212-21kworker/0:2+events19:59:280
69940599256312,2547cyclictest709793-21kworker/2:1+events19:45:512
69939899256311,2549cyclictest779850-21kworker/0:1+events23:23:370
69939899256311,2549cyclictest779850-21kworker/0:1+events23:23:370
69940599256212,2546cyclictest746390-21kworker/2:1+events21:34:382
69939899255810,2544cyclictest724557-21kworker/0:0+events20:32:320
69940599255612,2541cyclictest761002-21kworker/2:1+events22:19:202
69940599255612,2540cyclictest759088-21kworker/2:2+events22:22:202
69940599255512,2539cyclictest736937-21kworker/2:2+events21:02:372
69940599255511,2540cyclictest792453-21kworker/2:1+events23:57:492
69939899255512,2540cyclictest714320-21kworker/0:0+events20:13:040
69940599255412,2538cyclictest724268-21kworker/2:2+events20:22:432
69939899255412,2538cyclictest740409-21kworker/0:0+events21:17:040
69939899255411,2539cyclictest721056-21kworker/0:2+events20:39:250
69939899255312,2537cyclictest761035-21kworker/0:2+events22:23:070
69939899255211,2537cyclictest738761-21kworker/0:2+events21:12:060
6994059925514,2543cyclictest801387-21kworker/2:1+events00:27:262
69940599255111,2536cyclictest772149-21kworker/2:0+events22:54:172
69940599255012,2535cyclictest747988-21kworker/2:2+events21:41:492
69940599255012,2534cyclictest786771-21kworker/2:0+events00:08:252
69940599255012,2534cyclictest768881-21kworker/2:2+events22:47:242
69940599254912,2533cyclictest712569-21kworker/2:2+events19:58:212
6994019925498,2537cyclictest789907-21kworker/1:1+events00:10:221
69939899254912,2533cyclictest752671-21kworker/0:0+events21:59:170
69939899254911,2534cyclictest714320-21kworker/0:0+events19:53:490
69939899254810,2534cyclictest796255-21kworker/0:0+events00:14:300
69940599254712,2532cyclictest783260-21kworker/2:0+events23:29:412
69939899254712,2533cyclictest732162-21kworker/0:2+events20:50:050
69939899254712,2532cyclictest786595-21kworker/0:1+events23:41:470
69940599254612,2532cyclictest747988-21kworker/2:2+events21:55:072
69940599254612,2530cyclictest707990-21kworker/2:2+events19:35:132
69940599254512,2530cyclictest744757-21kworker/2:0+events21:27:022
69940599254512,2529cyclictest754705-21kworker/2:0+events22:08:402
69939899254512,2529cyclictest757549-21kworker/0:1+events22:12:260
69939899254512,2529cyclictest740409-21kworker/0:0+events21:35:430
69939899254412,2530cyclictest783080-21kworker/0:2+events23:30:030
69939899254412,2528cyclictest716212-21kworker/0:2+events20:01:230
69940599254312,2527cyclictest770512-21kworker/2:1+events22:56:582
69940599254212,2527cyclictest786771-21kworker/2:0+events23:45:552
69940599254110,2527cyclictest786771-21kworker/2:0+events23:41:012
69940199253712,2521cyclictest727310-21kworker/1:2+events20:38:161
69940199253412,2518cyclictest717715-21kworker/1:0+events20:04:451
69939899253412,2519cyclictest788365-21kworker/0:2+events00:08:490
69940599253112,2516cyclictest772149-21kworker/2:0+events23:03:052
6993989925309,2517cyclictest771967-21kworker/0:2+events22:55:260
69940599252611,2511cyclictest716181-21kworker/2:1+events20:47:452
69940599252011,2505cyclictest747988-21kworker/2:2+events21:49:072
69940199251912,2503cyclictest804401-21kworker/1:1+events00:34:421
69940599251812,2502cyclictest778310-21kworker/2:0+events23:14:522
6994019925189,2507cyclictest770605-21kworker/1:0+events22:55:031
69939899251810,2504cyclictest712720-21kworker/0:2+events19:48:310
69940599251612,2500cyclictest778310-21kworker/2:0+events23:17:522
6994019925159,2502cyclictest700852-21kworker/1:1+events19:20:181
69940599251410,2501cyclictest747988-21kworker/2:2+events22:03:482
69939899251112,2495cyclictest737142-21kworker/0:0+events21:07:580
69940599250912,2494cyclictest716181-21kworker/2:1+events21:21:432
69940599250912,2494cyclictest716181-21kworker/2:1+events21:21:432
69940799250813,2491cyclictest719222-21kworker/3:0+events20:21:113
69940199250612,2491cyclictest707804-21kworker/1:0+events19:50:251
69940199250510,2491cyclictest799193-21kworker/1:0+events00:17:101
69940599250211,2487cyclictest786771-21kworker/2:0+events23:50:532
69940599250112,2485cyclictest716181-21kworker/2:1+events20:50:512
69939899249912,2484cyclictest757549-21kworker/0:1+events22:17:470
69940599249812,2483cyclictest727497-21kworker/2:2+events20:41:412
69940199249812,2483cyclictest700852-21kworker/1:1+events19:29:051
69940199249812,2482cyclictest716092-21kworker/1:2+events19:57:581
69940199249810,2484cyclictest743307-21kworker/1:0+events21:30:241
69940199249712,2481cyclictest763520-21kworker/1:2+events22:26:121
69940199249712,2481cyclictest743307-21kworker/1:0+events21:39:101
69940599249612,2481cyclictest700977-21kworker/2:3+events19:21:512
69940199249612,2480cyclictest795038-21kworker/1:2+events00:24:231
69939899249612,2480cyclictest749648-21kworker/0:1+events21:44:530
69939899249512,2480cyclictest775228-21kworker/0:2+events23:11:470
69940599249412,2479cyclictest773813-21kworker/2:2+events23:06:062
69940599249412,2479cyclictest752851-21kworker/2:1+events21:54:242
69940599249412,2478cyclictest706065-21kworker/2:0+events19:42:032
69940199249412,2479cyclictest741674-21kworker/1:1+events21:17:281
69940199249412,2478cyclictest789907-21kworker/1:1+events00:01:561
69939899249412,2479cyclictest804339-21kworker/0:1+events00:33:550
69939899249412,2479cyclictest786595-21kworker/0:1+events23:37:590
69940599249312,2478cyclictest716181-21kworker/2:1+events21:05:392
69940799249212,2477cyclictest702965-21kworker/3:1+events19:27:333
69940599249212,2478cyclictest733683-21kworker/2:2+events20:55:042
69940199249211,2478cyclictest707804-21kworker/1:0+events19:46:371
69939899249212,2476cyclictest804339-21kworker/0:1+events00:39:340
69939899249112,2475cyclictest788365-21kworker/0:2+events23:46:390
69940599249012,2474cyclictest704202-21kworker/2:1+events19:31:442
6994019924906,2480cyclictest741674-21kworker/1:1+events21:22:061
6994019924906,2480cyclictest741674-21kworker/1:1+events21:22:061
69940199249012,2475cyclictest765634-21kworker/1:1+events22:31:301
69939899249011,2475cyclictest796255-21kworker/0:0+events00:26:410
69939899248912,2474cyclictest761035-21kworker/0:2+events22:33:240
69939899248911,2475cyclictest784947-21kworker/0:0+events23:52:450
69939899248911,2474cyclictest757549-21kworker/0:1+events22:09:040
69939899248812,2474cyclictest714320-21kworker/0:0+events20:05:510
69939899248812,2472cyclictest793000-21kworker/0:1+events00:03:290
69940599248712,2473cyclictest799479-21kworker/2:0+events00:35:062
6994019924879,2475cyclictest789907-21kworker/1:1+events00:07:411
69939899248712,2473cyclictest773598-21kworker/0:1+events23:00:020
69939899248712,2472cyclictest709459-21kworker/0:0+events19:39:010
69939899248712,2471cyclictest721056-21kworker/0:2+events20:29:030
69940599248612,2470cyclictest762750-21kworker/2:0+events22:36:242
69940199248612,2471cyclictest749825-21kworker/1:2+events22:00:471
69939899248611,2471cyclictest770153-21kworker/0:1+events22:46:390
69940599248512,2469cyclictest780036-21kworker/2:2+events23:34:122
69940199248512,2470cyclictest721263-21kworker/1:2+events20:19:141
69940599248412,2468cyclictest781661-21kworker/2:1+events23:24:422
69940599248412,2468cyclictest781661-21kworker/2:1+events23:24:422
69940199248212,2467cyclictest724496-21kworker/1:1+events20:54:181
69940599248111,2466cyclictest757461-21kworker/2:1+events22:10:562
69940599248010,2466cyclictest721600-21kworker/2:0+events20:16:562
69939899247910,2465cyclictest740409-21kworker/0:0+events21:34:130
69939899247811,2465cyclictest799506-21kworker/0:2+events00:21:010
69939899247811,2463cyclictest721056-21kworker/0:2+events20:18:050
69940199247512,2460cyclictest707804-21kworker/1:0+events19:32:541
69940199247412,2458cyclictest740037-21kworker/1:0+events21:14:011
69940199247012,2454cyclictest776767-21kworker/1:1+events23:09:531
69940199246411,2449cyclictest749825-21kworker/1:2+events21:47:131
69940599246112,2447cyclictest712569-21kworker/2:2+events19:50:032
69939899246112,2445cyclictest749648-21kworker/0:1+events21:50:340
69940599244411,2429cyclictest712569-21kworker/2:2+events20:00:152
69940199244410,2431cyclictest749825-21kworker/1:2+events22:10:351
69940799243712,2422cyclictest768851-21kworker/3:0+events22:46:183
69940199243712,2422cyclictest780067-21kworker/1:2+events23:19:001
69940199243712,2421cyclictest786685-21kworker/1:1+events23:41:251
69940599243512,2421cyclictest801387-21kworker/2:1+events00:30:072
6993989924329,2420cyclictest700734-21kworker/0:0+events19:16:270
69940199243110,2417cyclictest806322-21kworker/1:0+events00:39:571
69940199243014,2412cyclictest791620-21kworker/1:0+events23:57:021
69940199243010,2416cyclictest780067-21kworker/1:2+events23:22:051
69940199243010,2416cyclictest780067-21kworker/1:2+events23:22:041
69940199242612,2410cyclictest748202-21kworker/1:1+events21:54:441
69940199242112,2406cyclictest705943-21kworker/1:2+events19:35:351
69940199242011,2406cyclictest735583-21kworker/1:2+events21:06:471
69940199241812,2402cyclictest707804-21kworker/1:0+events19:42:261
69940199241512,2399cyclictest756071-21kworker/1:0+events22:19:411
69940199241412,2399cyclictest744908-21kworker/1:2+events21:29:401
6994019924127,2401cyclictest767286-21kworker/1:2+events22:39:251
69940199241012,2394cyclictest678107-21kworker/1:0+events19:14:551
69940199240910,2395cyclictest802736-21kworker/1:0+events00:27:481
69940799240811,2393cyclictest745027-21kworker/3:0+events21:40:193
69940199240810,2394cyclictest770605-21kworker/1:0+events23:00:251
69940199240712,2392cyclictest780067-21kworker/1:2+events23:48:571
69940199240710,2393cyclictest730545-21kworker/1:0+events20:46:141
69940199240610,2392cyclictest767286-21kworker/1:2+events22:51:591
69940199240512,2391cyclictest789907-21kworker/1:1+events23:50:051
69940199240511,2391cyclictest722845-21kworker/1:0+events20:29:501
69940799240312,2388cyclictest793062-21kworker/3:1+events00:10:443
69940799240212,2387cyclictest775167-21kworker/3:2+events23:04:343
69940799239912,2385cyclictest743369-21kworker/3:1+events21:25:073
69940199239911,2384cyclictest733951-21kworker/1:0+events21:04:531
69940799239612,2380cyclictest755985-21kworker/3:1+events22:07:323
69940799239612,2380cyclictest719222-21kworker/3:0+events20:25:413
69940199239312,2378cyclictest724496-21kworker/1:1+events20:30:351
69940799239212,2376cyclictest741581-21kworker/3:2+events21:22:533
69940799239212,2376cyclictest741581-21kworker/3:2+events21:22:523
69940799239012,2375cyclictest716433-21kworker/3:2+events20:04:243
69940599238310,2369cyclictest799479-21kworker/2:0+events00:22:062
69940799238110,2368cyclictest706094-21kworker/3:0+events19:33:413
69940199237611,2362cyclictest767286-21kworker/1:2+events22:42:051
69939899236710,2353cyclictest699029-21kworker/0:1+events19:13:260
69940799236312,2348cyclictest801109-21kworker/3:0+events00:25:543
69940799235412,2340cyclictest783464-21kworker/3:3+events23:35:423
69940799235212,2336cyclictest719222-21kworker/3:0+events20:08:543
69940199234610,2332cyclictest776767-21kworker/1:1+events23:14:271
69940799234411,2330cyclictest724202-21kworker/3:2+events20:31:453
69940799234111,2327cyclictest727407-21kworker/3:1+events20:35:123
69940799234010,2327cyclictest738732-21kworker/3:0+events21:11:213
69940799234010,2326cyclictest783464-21kworker/3:3+events23:50:293
69940799233711,2323cyclictest724202-21kworker/3:2+events20:57:223
69940799233612,2320cyclictest745027-21kworker/3:0+events21:52:273
69940799233312,2317cyclictest737029-21kworker/3:1+events21:04:063
69940799232614,2309cyclictest755985-21kworker/3:1+events22:17:023
69940799232112,2306cyclictest793062-21kworker/3:1+events00:05:463
69940799232111,2307cyclictest708022-21kworker/3:2+events19:38:153
6994079923209,2307cyclictest790868-21kworker/3:0+events23:58:593
69940799231911,2305cyclictest793062-21kworker/3:1+events00:15:413
69940799231712,2301cyclictest804250-21kworker/3:1+events00:32:463
69940799231711,2303cyclictest737029-21kworker/3:1+events21:09:273
69940799231512,2299cyclictest772379-21kworker/3:1+events23:16:203
69940799231512,2299cyclictest724202-21kworker/3:2+events20:48:093
69940799231110,2297cyclictest719222-21kworker/3:0+events20:17:433
69940799231012,2296cyclictest762508-21kworker/3:2+events22:50:073
69940199231012,2295cyclictest781747-21kworker/1:1+events23:29:181
69940799230711,2294cyclictest738732-21kworker/3:0+events21:15:343
69940799230410,2291cyclictest759636-21kworker/3:0+events22:24:413
69940199230011,2286cyclictest780067-21kworker/1:2+events23:32:401
69939899228012,2264cyclictest704436-21kworker/0:0+events19:28:180
69940599227311,2259cyclictest738703-21kworker/2:0+events21:15:582
69939899226711,2252cyclictest707835-21kworker/0:2+events19:34:260
6993989922669,2253cyclictest722754-21kworker/0:1+events20:22:200
69939899226310,2250cyclictest747930-21kworker/0:2+events21:46:030
69940599226211,2247cyclictest786771-21kworker/2:0+events00:12:592
69940599226111,2246cyclictest699177-21kworker/2:2+events19:13:032
69940599226110,2248cyclictest780036-21kworker/2:2+events23:37:362
69940799222812,2213cyclictest751254-21kworker/3:2+events21:55:533
69940599222711,2214cyclictest786771-21kworker/2:0+events00:00:282
69940199219211,2177cyclictest700976-21kworker/1:3+events19:18:221
69940799218411,2170cyclictest775167-21kworker/3:2+events23:23:583
69940799218411,2170cyclictest775167-21kworker/3:2+events23:23:583
69940799215910,2146cyclictest772379-21kworker/3:1+events22:58:303
69940799215111,2137cyclictest775167-21kworker/3:2+events23:34:343
6994079921319,2120cyclictest706094-21kworker/3:0+events19:45:063
69940799211910,2105cyclictest790868-21kworker/3:0+events00:02:423
69940799211811,2104cyclictest781719-21kworker/3:0+events23:25:283
69940799211611,2102cyclictest799161-21kworker/3:2+events00:24:453
69940799210611,2092cyclictest732284-21kworker/3:1+events20:52:453
69940799210611,2091cyclictest799161-21kworker/3:2+events00:35:503
69940799210510,2092cyclictest762508-21kworker/3:2+events22:41:203
69940799210510,2092cyclictest745027-21kworker/3:0+events22:02:193
6994079921019,2088cyclictest699086-21kworker/3:2+events19:21:033
6989372182152,26sleep10-21swapper/119:06:301
6991922156112,25sleep20-21swapper/219:09:442
6991342153104,44sleep30-21swapper/319:09:013
699068214497,17sleep00-21swapper/019:08:090
699407992915,10cyclictest0-21swapper/321:40:013
69940799223,7cyclictest746940-21latency_hist21:35:003
699407992212,7cyclictest702881-21ls19:20:003
69940799219,8cyclictest711351-21munin-run19:45:003
69940799209,8cyclictest700890-21munin-run19:15:003
69940799205,4cyclictest788442-21munin-run23:45:003
699407992013,4cyclictest767579-21munin-run22:40:003
69940799192,6cyclictest778642-21latency_hist23:15:013
69940799189,6cyclictest759388-21idleruntime-cro22:15:003
699407991811,7cyclictest0-21swapper/319:55:223
699407991810,6cyclictest0-21swapper/322:35:003
69940799179,5cyclictest764403-21cron22:30:003
699407991716,1cyclictest26450irq/143-i91523:08:213
699407991712,3cyclictest729771-21hddtemp_smartct20:40:133
69940799170,14cyclictest714523-21true19:55:003
699407991613,2cyclictest622-21gdbus20:15:003
69940799160,3cyclictest788678-21/usr/sbin/munin23:45:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional