You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 00:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Sun Aug 16, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
84711099627729,6240cyclictest898377-21kworker/3:2+events22:30:003
8471109935235,3513cyclictest888823-21kworker/3:0+events21:25:123
84709999332613,3310cyclictest951502-21kworker/0:0+events00:35:210
84710499328216,3260cyclictest871272-21kworker/1:2+events20:30:121
84711099328114,3261cyclictest882611-21kworker/3:2+events21:00:143
84709999306515,3046cyclictest850481-21kworker/0:1+events19:20:120
84710499306411,3047cyclictest929482-21kworker/1:1+events23:40:141
84709999306115,3042cyclictest854229-21kworker/0:0+events19:50:000
84711099296014,2941cyclictest861642-21kworker/3:2+events20:10:123
8471109929469,2933cyclictest872771-21kworker/3:2+events20:31:183
84710499291213,2895cyclictest916276-21kworker/1:1+events22:45:441
84711099288114,2862cyclictest861642-21kworker/3:2+events20:05:113
84710499287913,2862cyclictest898868-21kworker/1:2+events22:00:011
84709999285814,2840cyclictest936924-21kworker/0:1+events00:10:230
84711099285413,2838cyclictest848716-21kworker/3:1+events19:19:493
84710499285013,2833cyclictest906589-21kworker/1:0+events22:14:471
84709999284413,2825cyclictest922631-21kworker/0:1+events23:02:510
84709999283812,2822cyclictest861943-21kworker/0:2+events19:59:030
84710499283314,2814cyclictest929482-21kworker/1:1+events23:30:191
84711099283213,2815cyclictest860048-21kworker/3:1+events19:50:223
84710499282913,2812cyclictest866405-21kworker/1:0+events20:20:491
84710499282813,2811cyclictest864541-21kworker/1:2+events20:12:541
84710499282513,2808cyclictest856784-21kworker/1:0+events20:00:111
84711099281513,2798cyclictest878008-21kworker/3:1+events20:54:503
84711099281513,2798cyclictest878008-21kworker/3:1+events20:54:503
84710499281513,2798cyclictest908191-21kworker/1:2+events22:26:571
84711099281013,2793cyclictest871144-21kworker/3:0+events20:26:513
8471049928107,2799cyclictest897080-21kworker/1:0+events21:49:471
84711099280612,2790cyclictest884377-21kworker/3:0+events21:06:383
84710499280613,2789cyclictest926000-21kworker/1:0+events23:24:371
84710499280613,2789cyclictest879579-21kworker/1:1+events21:04:231
84710499280413,2787cyclictest950160-21kworker/1:3+events00:34:581
84710499280413,2787cyclictest942430-21kworker/1:0+events00:06:131
84710499280413,2787cyclictest856784-21kworker/1:0+events19:45:241
8471049928029,2789cyclictest935595-21kworker/1:3+events23:54:501
84710499280213,2787cyclictest908191-21kworker/1:2+events22:20:081
84710499280113,2784cyclictest856784-21kworker/1:0+events19:39:171
84710499279913,2783cyclictest874472-21kworker/1:0+events20:58:411
84710499279913,2782cyclictest940378-21kworker/1:2+events00:25:521
84710499279812,2782cyclictest856784-21kworker/1:0+events19:57:121
84710499279716,2777cyclictest871272-21kworker/1:2+events20:38:251
84710499279713,2780cyclictest917913-21kworker/1:2+events22:52:331
84710499279713,2780cyclictest866405-21kworker/1:0+events20:06:421
84710499279711,2782cyclictest903073-21kworker/1:1+events22:07:351
84711099279413,2777cyclictest876078-21kworker/3:2+events20:41:263
84709999279413,2777cyclictest856628-21kworker/0:2+events19:42:460
84709999279113,2774cyclictest943416-21kworker/0:0+events00:09:380
84711099278913,2772cyclictest887196-21kworker/3:1+events21:14:583
84709999278513,2768cyclictest929071-21kworker/0:0+events23:35:170
84710499278013,2766cyclictest903073-21kworker/1:1+events22:03:511
84711099277712,2762cyclictest887196-21kworker/3:1+events21:20:393
84710499277613,2759cyclictest892174-21kworker/1:2+events21:41:531
8471109927737,2762cyclictest903247-21kworker/3:1+events22:07:133
84711099277313,2756cyclictest951618-21kworker/3:0+events00:36:073
84711099277013,2753cyclictest888823-21kworker/3:0+events21:17:393
84711099277012,2754cyclictest922601-21kworker/3:2+events23:11:153
84711099276713,2750cyclictest918194-21kworker/3:0+events22:55:163
84711099276613,2749cyclictest924233-21kworker/3:0+events23:21:383
84711099276513,2748cyclictest861642-21kworker/3:2+events19:59:493
84711099276413,2747cyclictest946439-21kworker/3:1+events00:22:313
84711099276413,2747cyclictest851835-21kworker/3:2+events19:33:303
84711099276113,2744cyclictest895128-21kworker/3:2+events21:40:433
84711099276013,2743cyclictest863243-21kworker/3:1+events20:03:413
84710499276012,2746cyclictest924359-21kworker/1:2+events23:10:081
84711099275813,2741cyclictest846900-21kworker/3:0+events19:20:573
84709999275813,2741cyclictest872891-21kworker/0:1+events20:29:070
84710499275714,2738cyclictest940378-21kworker/1:2+events00:20:141
84711099275613,2739cyclictest936956-21kworker/3:1+events23:56:193
84711099275413,2737cyclictest871144-21kworker/3:0+events20:36:343
84711099274711,2732cyclictest913072-21kworker/3:0+events22:41:543
84710499274613,2729cyclictest917913-21kworker/1:2+events22:56:261
84711099274013,2724cyclictest927415-21kworker/3:1+events23:37:103
84709999273813,2721cyclictest893860-21kworker/0:2+events21:48:180
84711099273613,2720cyclictest858415-21kworker/3:2+events19:48:303
84710499272313,2706cyclictest892174-21kworker/1:2+events21:39:371
84709999271711,2702cyclictest924265-21kworker/0:2+events23:23:080
8471109927037,2692cyclictest909270-21kworker/3:0+events22:23:123
84710499270113,2685cyclictest922752-21kworker/1:0+events23:07:481
84710499269513,2680cyclictest876101-21kworker/1:1+events20:40:191
84710499269013,2672cyclictest940378-21kworker/1:2+events00:15:191
84710499269013,2672cyclictest940378-21kworker/1:2+events00:15:181
84709999268813,2672cyclictest878134-21kworker/0:2+events20:50:150
84709999268813,2672cyclictest878134-21kworker/0:2+events20:50:150
84711099268012,2664cyclictest898377-21kworker/3:2+events22:01:113
84710499267313,2656cyclictest885622-21kworker/1:0+events21:15:221
84709999267213,2657cyclictest892168-21kworker/0:0+events21:35:060
84711099266712,2651cyclictest948074-21kworker/3:2+events00:27:233
84710899266613,2649cyclictest857050-21kworker/2:1+events20:35:282
84709999266612,2650cyclictest901591-21kworker/0:1+events22:14:020
84709999266213,2645cyclictest872891-21kworker/0:1+events20:32:500
84710499265610,2642cyclictest840272-21kworker/1:0+events19:22:491
84709999265212,2636cyclictest878134-21kworker/0:2+events21:10:270
84711099265112,2635cyclictest914676-21kworker/3:2+events22:50:173
84709999265110,2638cyclictest901591-21kworker/0:1+events22:15:090
84709999264513,2629cyclictest893860-21kworker/0:2+events21:52:020
84709999264413,2627cyclictest869671-21kworker/0:0+events20:19:190
8471109926429,2630cyclictest940204-21kworker/3:2+events00:08:063
84710499264011,2627cyclictest840272-21kworker/1:0+events19:25:061
84709999263313,2617cyclictest854229-21kworker/0:0+events19:38:300
84709999263111,2616cyclictest885711-21kworker/0:0+events21:08:530
84709999262813,2612cyclictest945013-21kworker/0:2+events00:31:330
84710499262713,2610cyclictest874472-21kworker/1:0+events20:54:281
84710499262713,2610cyclictest874472-21kworker/1:0+events20:54:281
84709999262713,2610cyclictest901591-21kworker/0:1+events22:04:580
84709999262613,2611cyclictest908340-21kworker/0:0+events23:05:550
84709999262610,2612cyclictest899947-21kworker/0:0+events22:06:080
84711099262512,2610cyclictest922601-21kworker/3:2+events23:02:283
84711099262412,2608cyclictest946439-21kworker/3:1+events00:19:513
84711099262412,2608cyclictest946439-21kworker/3:1+events00:19:503
84710499262312,2607cyclictest909881-21kworker/1:0+events22:39:131
84710499262113,2604cyclictest926000-21kworker/1:0+events23:16:141
84710499261912,2603cyclictest929482-21kworker/1:1+events23:39:051
84710499261910,2607cyclictest840272-21kworker/1:0+events19:15:571
84710499261513,2599cyclictest888878-21kworker/1:2+events21:21:461
84710499261413,2597cyclictest869641-21kworker/1:1+events20:29:291
84709999261212,2596cyclictest924265-21kworker/0:2+events23:18:310
8471049926089,2596cyclictest909881-21kworker/1:0+events22:41:331
84711099260512,2590cyclictest935319-21kworker/3:2+events23:43:453
84709999260313,2586cyclictest887319-21kworker/0:1+events21:28:380
8471109925928,2580cyclictest914676-21kworker/3:2+events22:38:053
84710899259113,2575cyclictest916295-21kworker/2:1+events22:45:222
84709999258812,2573cyclictest878134-21kworker/0:2+events20:57:100
84709999258513,2568cyclictest908340-21kworker/0:0+events23:11:370
8471109925848,2572cyclictest893530-21kworker/3:1+events21:45:593
84710499258312,2567cyclictest892174-21kworker/1:2+events21:32:251
84709999258012,2565cyclictest908340-21kworker/0:0+events22:30:230
84710499257812,2563cyclictest909881-21kworker/1:0+events22:31:331
84710499257812,2562cyclictest898868-21kworker/1:2+events21:52:261
84709999257812,2562cyclictest893860-21kworker/0:2+events21:56:370
84710499257612,2561cyclictest877978-21kworker/1:2+events20:47:581
84710499257612,2561cyclictest855167-21kworker/1:3+events19:43:091
84709999257612,2560cyclictest914833-21kworker/0:1+events22:42:400
84710499257512,2560cyclictest949945-21kworker/1:0+events00:39:331
84709999257513,2559cyclictest908340-21kworker/0:0+events22:38:280
84710499257412,2559cyclictest944773-21kworker/1:1+events00:14:331
84710499257412,2559cyclictest917913-21kworker/1:2+events23:02:051
8471049925739,2560cyclictest890537-21kworker/1:0+events21:26:221
84711099257212,2556cyclictest898377-21kworker/3:2+events21:58:083
84710499257212,2556cyclictest930561-21kworker/1:3+events23:27:401
84709999257212,2556cyclictest935262-21kworker/0:0+events23:47:320
84710499257112,2555cyclictest856784-21kworker/1:0+events19:50:451
84710499256711,2552cyclictest937614-21kworker/1:0+events23:57:061
84711099256413,2548cyclictest851835-21kworker/3:2+events19:26:143
8470999925589,2546cyclictest852128-21kworker/0:2+events19:27:460
84709999255812,2542cyclictest918131-21kworker/0:1+events22:51:470
84709999255810,2545cyclictest949839-21kworker/0:1+events00:27:470
84710499255711,2542cyclictest903073-21kworker/1:1+events22:16:201
84709999255112,2535cyclictest936924-21kworker/0:1+events00:03:560
84709999254912,2533cyclictest848394-21kworker/0:2+events19:17:520
84711099254513,2528cyclictest855047-21kworker/3:0+events19:37:433
84711099254412,2528cyclictest866989-21kworker/3:1+events20:15:283
84711099253910,2525cyclictest900008-21kworker/3:1+events21:53:343
84711099253712,2521cyclictest948074-21kworker/3:2+events00:34:123
84711099253712,2521cyclictest914676-21kworker/3:2+events22:48:013
84709999253512,2519cyclictest866469-21kworker/0:2+events20:07:520
84711099253312,2517cyclictest924233-21kworker/3:0+events23:15:273
84711099253311,2518cyclictest935319-21kworker/3:2+events23:50:593
84711099253211,2517cyclictest936956-21kworker/3:1+events23:49:513
84711099253211,2517cyclictest893530-21kworker/3:1+events21:38:513
84711099253112,2517cyclictest940204-21kworker/3:2+events00:00:073
84711099253112,2515cyclictest913072-21kworker/3:0+events22:34:403
84711099253012,2514cyclictest930643-21kworker/3:2+events23:31:503
84711099253012,2514cyclictest866989-21kworker/3:1+events20:21:123
84711099252910,2515cyclictest898377-21kworker/3:2+events22:15:333
84710899252912,2514cyclictest882878-21kworker/2:0+events21:16:552
84711099252712,2512cyclictest940204-21kworker/3:2+events00:11:293
84711099252712,2511cyclictest878008-21kworker/3:1+events20:47:353
84711099252712,2511cyclictest856751-21kworker/3:1+events19:40:273
84711099252312,2507cyclictest888823-21kworker/3:0+events21:30:543
84709999251510,2501cyclictest874488-21kworker/0:0+events20:36:140
84709999251311,2498cyclictest874488-21kworker/0:0+events20:43:450
84709999251212,2496cyclictest864572-21kworker/0:0+events20:04:490
84709999250612,2490cyclictest869671-21kworker/0:0+events20:22:420
8471049925027,2491cyclictest866405-21kworker/1:0+events20:17:231
84710499250013,2484cyclictest887287-21kworker/1:1+events21:14:361
8470999924990,2495cyclictest846683-21kworker/0:0+events19:14:490
84709999249812,2482cyclictest908340-21kworker/0:0+events22:47:150
84709999249712,2481cyclictest929071-21kworker/0:0+events23:33:450
84709999249512,2480cyclictest945013-21kworker/0:2+events00:22:530
84709999249512,2480cyclictest936924-21kworker/0:1+events23:50:380
84709999249512,2480cyclictest908340-21kworker/0:0+events22:59:260
84709999249512,2479cyclictest929071-21kworker/0:0+events23:25:450
84710499249312,2477cyclictest853574-21kworker/1:1+events19:31:351
84709999249312,2478cyclictest887319-21kworker/0:1+events21:19:320
84709999249312,2477cyclictest893860-21kworker/0:2+events21:42:150
84709999249311,2478cyclictest868075-21kworker/0:1+events20:13:150
84709999249212,2476cyclictest936924-21kworker/0:1+events23:56:430
84709999249212,2476cyclictest878134-21kworker/0:2+events21:03:590
84710499249012,2474cyclictest848332-21kworker/1:1+events19:13:201
84710499249011,2476cyclictest935595-21kworker/1:3+events23:48:181
84709999248612,2472cyclictest908340-21kworker/0:0+events22:25:070
84709999248612,2470cyclictest906705-21kworker/0:2+events22:21:180
8470999924847,2474cyclictest935262-21kworker/0:0+events23:42:580
84710499248212,2466cyclictest885622-21kworker/1:0+events21:09:171
84710499247710,2463cyclictest935595-21kworker/1:3+events00:02:001
84710899247612,2460cyclictest946541-21kworker/2:1+events00:19:062
84710899247612,2460cyclictest946541-21kworker/2:1+events00:19:062
84710899246612,2451cyclictest852100-21kworker/2:2+events19:52:152
84711099246513,2448cyclictest922601-21kworker/3:2+events23:07:043
84709999246512,2450cyclictest854229-21kworker/0:0+events19:31:580
84709999245712,2441cyclictest859834-21kworker/0:1+events19:53:200
84711099244811,2434cyclictest924233-21kworker/3:0+events23:27:173
84711099244610,2433cyclictest843583-21kworker/3:2+events19:13:423
8471109924459,2433cyclictest878008-21kworker/3:1+events20:59:273
84710899243811,2423cyclictest910035-21kworker/2:2+events23:18:552
84711099242611,2412cyclictest904842-21kworker/3:0+events22:10:593
84710899240912,2393cyclictest891929-21kworker/2:1+events22:02:192
84710899240910,2396cyclictest929316-21kworker/2:1+events23:47:072
84710899240812,2392cyclictest896840-21kworker/2:2+events21:45:372
84710899240812,2392cyclictest845582-21kworker/2:1+events19:18:162
84710899240312,2387cyclictest910035-21kworker/2:2+events23:00:122
84710899239212,2377cyclictest914647-21kworker/2:0+events22:40:222
84710899239212,2376cyclictest850418-21kworker/2:0+events19:24:222
8470999923928,2380cyclictest887319-21kworker/0:1+events21:22:320
84709999238710,2373cyclictest878134-21kworker/0:2+events20:47:140
84710899237112,2356cyclictest891929-21kworker/2:1+events22:26:122
84710899234612,2330cyclictest891929-21kworker/2:1+events21:33:112
84710899234312,2327cyclictest903158-21kworker/2:0+events22:05:452
84710899233112,2316cyclictest879282-21kworker/2:2+events20:51:002
84710899233112,2316cyclictest879282-21kworker/2:2+events20:51:002
84710899232412,2308cyclictest888857-21kworker/2:2+events21:25:352
84710899232312,2307cyclictest891929-21kworker/2:1+events21:42:362
84710899232311,2309cyclictest910035-21kworker/2:2+events22:36:092
84710899232211,2308cyclictest874689-21kworker/2:0+events20:45:412
84710899231612,2300cyclictest880887-21kworker/2:1+events21:00:362
84709999230910,2296cyclictest887319-21kworker/0:1+events21:30:310
84709999230412,2289cyclictest936924-21kworker/0:1+events00:16:280
84709999230412,2289cyclictest936924-21kworker/0:1+events00:16:280
8471089921079,2094cyclictest927535-21kworker/2:0+events23:28:512
8471089919999,1986cyclictest838643-21kworker/2:2+events19:10:172
8466002157113,24sleep10-21swapper/119:06:071
8466802148101,42sleep00-21swapper/019:07:060
8465502145101,25sleep30-21swapper/319:05:283
8466772144111,26sleep20-21swapper/219:07:042
84710899322,25cyclictest926077-21awk23:15:002
84710899322,20cyclictest0-21swapper/222:00:002
84710899310,27cyclictest907791-21python322:15:202
84710899301,24cyclictest933975-21munin-run23:40:012
847108993012,15cyclictest874637-21basename20:35:002
84710899291,23cyclictest882824-21basename21:00:002
84710899281,23cyclictest941952-21sleep00:05:002
84710899272,22cyclictest0-21swapper/200:00:002
84710899272,21cyclictest950145-21basename00:30:002
84710899271,14cyclictest854543-21ntpq19:30:192
84710899271,12cyclictest885969-21munin-run21:10:002
847108992616,7cyclictest0-21swapper/222:55:152
84710899261,21cyclictest864879-21apt-get20:05:002
847108992518,5cyclictest740-21snmpd00:05:272
84710899241,20cyclictest887560-21idleruntime-cro21:15:002
84710899241,19cyclictest856976-21systemctl19:40:002
847108992410,10cyclictest895479-21perf-exec21:40:002
84710899240,22cyclictest0-21swapper/220:15:172
84710899231,9cyclictest923729-21ntpq23:05:202
847108992316,4cyclictest558333-21systemd-journal20:30:012
847108992314,6cyclictest929253-21awk23:25:002
84710899231,18cyclictest932403-21awk23:35:002
84710899231,18cyclictest900218-21sleep21:55:002
847108992216,4cyclictest421ktimers/222:15:002
847108992212,6cyclictest0-21swapper/219:40:142
84710899221,18cyclictest951712-21munin-run00:35:002
84710899221,18cyclictest909991-21idleruntime-cro22:25:002
84710899221,18cyclictest866734-21awk20:10:002
84710899221,17cyclictest913403-21munin-run22:35:002
84710899221,17cyclictest862644-21awk19:55:212
84710899211,17cyclictest919743-21munin-run22:55:002
84710899211,17cyclictest853767-21basename19:29:592
84710899211,11cyclictest947500-21gcc00:20:192
84710899209,5cyclictest938752-10sh23:55:002
84710899201,16cyclictest860144-21perf19:50:002
84710899200,9cyclictest934981-21python323:40:222
84710899191,15cyclictest945114-21munin-run00:15:002
84710899190,12cyclictest877249-21ntpq20:40:162
84710899190,10cyclictest867362-21sed20:10:152
84710899181,9cyclictest870352-21df20:20:122
84710899181,3cyclictest889648-21hddtemp_smartct21:20:152
84710899181,14cyclictest953292-21apt00:40:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional