You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-11 - 04:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot3s.osadl.org (updated Sat Apr 11, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
190412223147,24sleep20-21swapper/219:08:082
189022223192,21sleep00-21swapper/019:06:210
188552203166,25sleep30-21swapper/319:05:433
191422201165,24sleep10-21swapper/119:09:281
1791121480,3sleep11927599cyclictest21:30:211
475921180,4sleep11927599cyclictest21:00:191
226922650,2sleep00-21swapper/000:10:110
66752600,5sleep11927599cyclictest19:50:241
66752600,5sleep11927599cyclictest19:50:241
109182590,4sleep11927599cyclictest23:40:241
80742470,1sleep121-21rcuc/122:20:251
199812470,1sleep30-21swapper/321:35:173
1928599401,28cyclictest0-21swapper/322:49:513
19285993725,3cyclictest0-21swapper/320:06:113
1927099379,13cyclictest3256-21munin-run00:40:010
1927099379,13cyclictest3256-21munin-run00:40:010
115062370,2sleep39-21rcu_preempt21:15:223
19285993624,4cyclictest0-21swapper/319:37:033
1928599351,14cyclictest0-21swapper/323:30:033
1928599341,12cyclictest0-21swapper/300:13:153
1928099331,13cyclictest0-21swapper/221:28:012
1927599330,18cyclictest0-21swapper/120:13:211
1927099336,12cyclictest1374-21awk20:55:010
237662320,7sleep2311ktimersoftd/219:15:262
19285993212,4cyclictest7912-21sh23:35:153
1928599321,14cyclictest0-21swapper/319:10:103
1928599321,14cyclictest0-21swapper/300:00:273
1928099320,26cyclictest0-21swapper/221:10:492
1927599321,10cyclictest0-21swapper/120:02:251
1928599311,15cyclictest0-21swapper/321:26:473
1928099311,12cyclictest30239-21sshd23:10:412
1928099310,23cyclictest0-21swapper/222:31:162
1927599311,9cyclictest0-21swapper/123:30:291
1927599310,23cyclictest0-21swapper/119:31:451
1927599310,21cyclictest0-21swapper/120:31:291
1928599301,15cyclictest0-21swapper/321:52:233
1928599300,15cyclictest0-21swapper/322:07:353
1928599300,12cyclictest0-21swapper/322:31:433
1928099301,13cyclictest0-21swapper/220:48:572
1927599301,26cyclictest0-21swapper/121:07:131
1927599301,11cyclictest15857-21ntp_states21:25:211
1927099300,12cyclictest14545-21kworker/0:221:27:410
101952300,5sleep01927099cyclictest22:25:260
1928599291,26cyclictest0-21swapper/300:17:233
1928599291,19cyclictest18060-21ntp_states21:30:233
1928599291,12cyclictest0-21swapper/300:39:393
1928599291,12cyclictest0-21swapper/300:39:393
1928599290,11cyclictest13924-21switchtime21:20:253
1928099291,9cyclictest0-21swapper/220:28:052
1928099291,12cyclictest0-21swapper/222:45:322
1928099291,12cyclictest0-21swapper/221:43:532
1927599291,12cyclictest0-21swapper/121:15:331
1927599291,10cyclictest0-21swapper/123:01:371
1927599290,11cyclictest0-21swapper/100:36:451
1927599290,11cyclictest0-21swapper/100:36:441
1927099292,9cyclictest19434-21kworker/0:219:17:010
19270992911,15cyclictest28734-21munin-run19:30:010
52082280,3sleep230-21rcuc/219:50:012
1928599281,17cyclictest0-21swapper/319:26:113
1928599281,12cyclictest0-21swapper/322:50:553
1928599281,12cyclictest0-21swapper/322:04:273
1928599281,11cyclictest0-21swapper/323:40:233
1928599281,11cyclictest0-21swapper/323:17:193
1928599281,10cyclictest7979-21diskmemload23:53:073
1928599280,23cyclictest0-21swapper/320:31:303
1928599280,13cyclictest0-21swapper/323:21:393
1928599280,13cyclictest0-21swapper/323:21:393
1928599280,12cyclictest0-21swapper/300:32:113
1928099281,9cyclictest0-21swapper/221:03:252
1927599281,11cyclictest0-21swapper/119:47:011
1927599281,11cyclictest0-21swapper/119:26:091
1927599280,2cyclictest0-21swapper/120:42:191
1927599280,26cyclictest0-21swapper/123:50:251
1927599280,21cyclictest0-21swapper/100:13:531
1927599280,11cyclictest0-21swapper/123:11:211
1927599280,11cyclictest0-21swapper/122:04:371
19285992715,3cyclictest0-21swapper/319:47:393
1928599271,13cyclictest0-21swapper/321:03:153
1928599271,13cyclictest0-21swapper/300:27:293
1928599271,12cyclictest0-21swapper/323:01:033
1928599271,12cyclictest0-21swapper/320:51:033
1928599271,11cyclictest0-21swapper/321:42:593
1928599271,11cyclictest0-21swapper/320:47:453
1928599271,11cyclictest0-21swapper/319:52:593
1928599271,11cyclictest0-21swapper/319:52:593
1928599270,8cyclictest0-21swapper/319:20:133
1928599270,10cyclictest0-21swapper/300:06:313
1928099271,18cyclictest0-21swapper/219:10:292
1928099271,12cyclictest0-21swapper/219:53:212
1928099271,12cyclictest0-21swapper/219:53:212
1928099271,12cyclictest0-21swapper/200:26:412
1928099271,10cyclictest0-21swapper/200:15:132
1928099270,12cyclictest0-21swapper/222:00:492
1927599271,24cyclictest0-21swapper/100:02:491
1927599271,10cyclictest0-21swapper/122:47:171
1927599271,10cyclictest0-21swapper/119:40:491
1927599270,17cyclictest0-21swapper/119:35:411
1927599270,12cyclictest0-21swapper/122:44:051
1927599270,12cyclictest0-21swapper/121:49:011
1927599270,12cyclictest0-21swapper/121:40:191
1927599270,11cyclictest0-21swapper/122:18:131
1927599270,11cyclictest0-21swapper/119:24:571
1927599270,10cyclictest0-21swapper/123:59:451
1927099272,9cyclictest373-21kworker/0:319:52:570
1927099272,9cyclictest373-21kworker/0:319:52:570
1927099271,14cyclictest689-21awk19:40:010
1928599269,3cyclictest0-21swapper/322:22:313
1928599269,3cyclictest0-21swapper/322:15:353
1928599268,9cyclictest0-21swapper/319:16:553
1928599267,3cyclictest0-21swapper/323:11:103
1928599261,9cyclictest0-21swapper/322:44:593
1928599261,18cyclictest0-21swapper/320:04:113
1928599261,12cyclictest0-21swapper/321:59:073
1928599261,12cyclictest0-21swapper/321:48:473
1928599261,11cyclictest0-21swapper/322:14:273
1928599261,11cyclictest0-21swapper/320:16:553
1928599261,10cyclictest0-21swapper/300:22:553
1928099261,12cyclictest0-21swapper/221:57:212
1928099261,10cyclictest0-21swapper/200:07:452
1928099260,12cyclictest0-21swapper/222:27:242
1928099260,12cyclictest0-21swapper/221:18:452
1928099260,11cyclictest0-21swapper/223:51:412
1928099260,11cyclictest0-21swapper/222:17:332
1928099260,10cyclictest0-21swapper/221:38:372
1928099260,10cyclictest0-21swapper/220:21:292
1927599261,9cyclictest27191-21timerandwakeup21:50:251
1927599261,9cyclictest0-21swapper/120:56:571
1927599261,13cyclictest0-21swapper/100:26:291
1927599261,11cyclictest0-21swapper/121:35:271
1927599261,11cyclictest0-21swapper/120:24:351
1927599260,9cyclictest0-21swapper/122:25:451
1927599260,12cyclictest0-21swapper/122:55:291
1927599260,11cyclictest0-21swapper/119:15:411
1927599260,11cyclictest0-21swapper/100:20:411
1927599260,11cyclictest0-21swapper/100:06:011
1927099269,15cyclictest21802-21awk22:55:020
1927099261,9cyclictest18228-21kworker/0:120:23:090
226912250,3sleep30-21swapper/322:55:153
19285992516,3cyclictest0-21swapper/320:44:393
19285992511,8cyclictest0-21swapper/319:58:073
1928599251,11cyclictest9177-21diskstats22:25:153
1928599251,10cyclictest0-21swapper/323:28:033
1928599251,10cyclictest0-21swapper/319:44:273
1928099251,9cyclictest0-21swapper/222:54:492
1928099251,10cyclictest0-21swapper/219:21:172
1928099250,12cyclictest0-21swapper/200:10:252
1928099250,10cyclictest0-21swapper/221:21:412
1927599251,9cyclictest0-21swapper/123:06:291
1927599251,9cyclictest0-21swapper/120:09:571
1927599251,8cyclictest0-21swapper/123:28:291
1927599251,7cyclictest0-21swapper/120:45:531
1927599251,11cyclictest0-21swapper/122:50:531
1927599251,10cyclictest0-21swapper/122:09:331
1927599251,10cyclictest0-21swapper/121:10:371
1927599251,10cyclictest0-21swapper/120:54:231
1927599251,10cyclictest0-21swapper/120:36:211
1927599251,10cyclictest0-21swapper/120:25:591
1927599250,9cyclictest0-21swapper/123:15:291
1927599250,11cyclictest0-21swapper/121:56:481
1927599250,11cyclictest0-21swapper/100:31:331
1927599250,10cyclictest0-21swapper/122:14:331
1927099259,14cyclictest0-21swapper/023:40:010
1927099252,9cyclictest29914-21kworker/0:122:05:310
1927099252,7cyclictest24729-21kworker/0:320:38:010
1927099251,9cyclictest7755-21kworker/0:321:13:080
1927099251,9cyclictest30409-21kworker/0:123:19:230
1927099251,9cyclictest29079-21kworker/0:020:42:010
19270992515,5cyclictest22251-21kworker/0:100:09:080
1927099251,10cyclictest1014-21kworker/0:221:00:090
1928599249,3cyclictest0-21swapper/319:30:473
1928599241,10cyclictest0-21swapper/323:55:033
1928599240,10cyclictest0-21swapper/322:38:393
1928099244,3cyclictest0-21swapper/219:41:572
1928099241,8cyclictest0-21swapper/220:05:452
1928099241,12cyclictest0-21swapper/219:56:382
1928099241,11cyclictest0-21swapper/220:19:452
1928099241,10cyclictest0-21swapper/221:48:092
1928099240,7cyclictest0-21swapper/222:36:052
1928099240,11cyclictest0-21swapper/223:35:412
1928099240,11cyclictest0-21swapper/222:42:362
1928099240,11cyclictest0-21swapper/221:51:492
1928099240,10cyclictest0-21swapper/223:57:572
1927599248,3cyclictest0-21swapper/120:17:371
1927599241,9cyclictest0-21swapper/119:10:571
1927599241,8cyclictest0-21swapper/100:15:291
1927599241,11cyclictest0-21swapper/122:35:191
1927599240,7cyclictest0-21swapper/121:20:451
1927599240,11cyclictest0-21swapper/123:20:371
1927599240,11cyclictest0-21swapper/123:20:371
1927099245,11cyclictest87350irq/126-enp1s0-20:07:090
1927099242,8cyclictest29914-21kworker/0:122:02:250
1927099240,9cyclictest19434-21kworker/0:219:22:090
1928599239,9cyclictest0-21swapper/320:27:503
1928599239,3cyclictest0-21swapper/323:05:263
1928599239,3cyclictest0-21swapper/320:22:553
1928599235,3cyclictest0-21swapper/321:05:513
1928099231,9cyclictest0-21swapper/223:33:412
1928099231,8cyclictest0-21swapper/223:05:052
1928099231,12cyclictest0-21swapper/223:21:292
1928099231,12cyclictest0-21swapper/223:21:292
1928099231,12cyclictest0-21swapper/200:03:292
1928099231,11cyclictest0-21swapper/222:10:232
1928099231,10cyclictest0-21swapper/221:05:292
1928099230,13cyclictest0-21swapper/200:23:252
1928099230,11cyclictest0-21swapper/223:29:092
1928099230,11cyclictest0-21swapper/223:19:372
1928099230,10cyclictest0-21swapper/221:31:372
1928099230,10cyclictest0-21swapper/219:26:372
1927599231,11cyclictest0-21swapper/119:55:251
1927599230,9cyclictest0-21swapper/123:39:491
1927599230,18cyclictest87550irq/128-enp1s0-23:45:571
1927099235,12cyclictest87550irq/128-enp1s0-21:22:200
1927099232,8cyclictest26190-21kworker/0:019:44:250
1927099230,16cyclictest30409-21kworker/0:123:13:210
1928599229,9cyclictest0-21swapper/320:56:073
1928599221,11cyclictest0-21swapper/320:36:353
1928599220,13cyclictest0-21swapper/321:12:353
1928099221,11cyclictest0-21swapper/220:03:562
1928099220,7cyclictest0-21swapper/223:43:092
1928099220,12cyclictest0-21swapper/223:04:212
1928099220,10cyclictest0-21swapper/222:08:532
1928099220,10cyclictest0-21swapper/200:35:492
1928099220,10cyclictest0-21swapper/200:35:492
1927599221,10cyclictest0-21swapper/122:31:391
1927099228,3cyclictest10781-21kworker/0:122:45:030
1927099225,12cyclictest87650irq/129-enp1s0-21:46:090
1927099225,12cyclictest87350irq/126-enp1s0-19:49:010
1927099225,10cyclictest87350irq/126-enp1s0-23:25:490
1927099222,8cyclictest28475-21kworker/0:119:30:010
1927099221,8cyclictest7268-21kworker/0:219:57:570
1927099221,18cyclictest17393-21munin-run22:45:010
1927099220,13cyclictest23973-21kworker/0:323:09:290
1928599218,3cyclictest0-21swapper/320:10:113
1928099211,10cyclictest0-21swapper/220:35:372
1928099210,11cyclictest0-21swapper/223:46:372
1927099216,8cyclictest22569-21kworker/0:122:57:010
1927099212,9cyclictest8972-21kworker/0:023:42:530
1927099211,8cyclictest9446-21kworker/0:323:45:070
19270992115,3cyclictest26322-21grep21:50:150
1927099211,11cyclictest18224-21/usr/sbin/munin00:00:250
19270992110,2cyclictest18645-21kworker/0:121:35:170
1928599201,11cyclictest0-21swapper/323:45:253
1928099206,3cyclictest0-21swapper/220:52:252
1928099200,10cyclictest0-21swapper/222:21:092
1927099208,3cyclictest8357-21kworker/0:322:23:310
1927099207,3cyclictest18228-21kworker/0:120:34:350
1927099207,2cyclictest23973-21kworker/0:323:04:230
1927099203,10cyclictest827-21runrttasks21:34:410
1927099202,9cyclictest20936-21kworker/0:021:43:170
1927099202,8cyclictest1807-21kworker/0:322:10:490
1927099202,11cyclictest22251-21kworker/0:100:28:090
1927099201,8cyclictest2358-21kworker/0:223:31:230
1927099201,8cyclictest1014-21kworker/0:220:57:390
19270992014,2cyclictest87350irq/126-enp1s0-00:20:130
19270992012,7cyclictest7-21ksoftirqd/020:10:530
1927099201,10cyclictest4430-21/usr/sbin/munin22:15:240
1928099191,11cyclictest0-21swapper/220:56:132
1928099191,11cyclictest0-21swapper/200:33:292
1927099198,2cyclictest8357-21kworker/0:322:33:410
1927099198,2cyclictest2358-21kworker/0:223:22:270
1927099198,2cyclictest2358-21kworker/0:223:22:270
1927099195,5cyclictest15458-21kworker/0:123:55:120
1927099194,10cyclictest87350irq/126-enp1s0-00:16:360
1927099193,11cyclictest87350irq/126-enp1s0-21:08:490
1927099191,10cyclictest19472-21/usr/sbin/munin19:10:210
1927099191,10cyclictest15131-21kworker/0:222:39:410
1927099190,9cyclictest7755-21kworker/0:321:17:380
1928099185,4cyclictest29120-21cat19:30:102
1928099181,9cyclictest0-21swapper/222:59:572
1927099185,2cyclictest15458-21kworker/0:123:50:550
1927099181,2cyclictest18228-21kworker/0:120:29:250
181532181,2sleep00-21swapper/020:17:410
1928099171,7cyclictest27817-21fschecks_count20:40:152
1928099170,10cyclictest0-21swapper/220:34:412
1927099175,4cyclictest7979-21diskmemload00:33:460
1927099175,2cyclictest23182-21kworker/0:221:58:450
1927099172,9cyclictest9474-21kworker/0:120:04:290
1927099172,2cyclictest24729-21kworker/0:320:45:210
161282171,2sleep20-21swapper/220:14:542
19280991611,3cyclictest31504-21diskstats19:35:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional