You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 11:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Thu Dec 11, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5225211597,12sleep30-21swapper/319:05:353
5284211497,12sleep20-21swapper/219:06:182
5223211494,15sleep10-21swapper/119:05:331
5509210380,18sleep00-21swapper/019:09:120
260012690,1sleep10-21swapper/122:20:151
260012690,1sleep10-21swapper/122:20:141
183722690,0sleep00-21swapper/022:12:070
560399210,19cyclictest0-21swapper/319:20:143
560199210,19cyclictest0-21swapper/119:20:131
5602992017,2cyclictest9840-21kworker/u8:023:47:052
560299200,15cyclictest0-21swapper/222:49:042
145842200,1sleep10-21swapper/122:41:141
5602991916,2cyclictest3260-21kworker/u8:223:12:042
5602991916,2cyclictest22294-21kworker/u8:122:56:072
5602991916,2cyclictest20030-21kworker/u8:200:33:052
5602991915,2cyclictest0-21swapper/220:10:122
560299191,17cyclictest0-21swapper/200:12:052
560299190,2cyclictest0-21swapper/219:45:152
560299190,14cyclictest0-21swapper/222:42:052
560299182,2cyclictest0-21swapper/222:25:042
5602991815,2cyclictest22294-21kworker/u8:122:52:042
560299181,2cyclictest0-21swapper/222:19:042
560299180,13cyclictest0-21swapper/223:17:042
50972180,0sleep30-21swapper/300:11:593
560399171,13cyclictest0-21swapper/322:20:163
560399171,13cyclictest0-21swapper/322:20:153
560399170,15cyclictest0-21swapper/321:00:123
5602991714,2cyclictest3916-21kworker/u8:121:58:052
5602991714,2cyclictest24210-21kworker/u8:120:09:042
5602991714,2cyclictest23499-21kworker/u8:000:23:052
5602991714,2cyclictest18736-21kworker/u8:122:13:052
5602991714,2cyclictest15101-21kworker/u8:219:16:042
560299171,14cyclictest21854-21diskmemload00:06:432
560299170,12cyclictest0-21swapper/219:31:052
560399161,13cyclictest0-21swapper/300:04:023
5602991613,2cyclictest5495-21kworker/u8:020:29:042
5602991613,2cyclictest5269-21kworker/u8:119:11:042
5602991613,2cyclictest31919-21kworker/u8:221:30:042
5602991613,2cyclictest28671-21kworker/u8:022:23:072
5602991613,2cyclictest28671-21kworker/u8:022:23:062
5602991613,2cyclictest25432-21kworker/u8:021:20:052
5602991613,2cyclictest14127-21kworker/u8:123:58:062
5602991613,2cyclictest13589-21kworker/u8:120:54:042
560299160,2cyclictest0-21swapper/221:26:042
560299160,14cyclictest0-21swapper/220:49:552
5601991611,3cyclictest29949-21wc21:50:281
5601991611,3cyclictest0-21swapper/123:00:011
560199160,3cyclictest26646-21latency_hist21:15:001
560199160,14cyclictest0-21swapper/123:45:191
560399151,3cyclictest32191-21df_abs23:00:133
560399151,3cyclictest21125-21ssh23:21:293
5603991510,3cyclictest1969-21cpuspeed_turbos20:20:133
5603991510,3cyclictest0-21swapper/322:56:143
560399150,13cyclictest0-21swapper/322:41:133
560299152,2cyclictest14127-21kworker/u8:123:32:052
5602991512,2cyclictest5495-21kworker/u8:020:37:032
5602991512,2cyclictest30629-21kworker/u8:023:26:052
5602991512,2cyclictest25432-21kworker/u8:021:18:042
5602991512,2cyclictest24210-21kworker/u8:119:58:052
5602991512,2cyclictest1702-21kworker/u8:221:09:042
5602991512,2cyclictest11574-21kworker/u8:119:28:042
5602991512,2cyclictest0-21swapper/200:16:432
560299151,12cyclictest8621-21munin-node2
560299151,12cyclictest4582-21sh23:38:402
560299151,12cyclictest0-21swapper/222:06:312
560299150,3cyclictest0-21swapper/223:40:002
560299150,2cyclictest0-21swapper/222:02:052
560299150,14cyclictest0-21swapper/221:48:052
560299150,10cyclictest0-21swapper/223:54:012
560199151,3cyclictest16000-21sh21:35:541
560099151,2cyclictest15389-21taskset22:10:000
5600991510,3cyclictest28274-21turbostat.cron21:49:550
560399149,3cyclictest0-21swapper/322:36:593
5603991411,2cyclictest0-21swapper/323:55:033
5603991411,2cyclictest0-21swapper/323:50:143
5603991410,2cyclictest24405-21munin-node3
5603991410,2cyclictest0-21swapper/323:45:113
5603991410,2cyclictest0-21swapper/300:05:083
560399140,2cyclictest0-21swapper/323:33:133
560399140,13cyclictest0-21swapper/322:06:523
560399140,12cyclictest21854-21diskmemload21:57:423
560399140,12cyclictest0-21swapper/323:40:183
560399140,12cyclictest0-21swapper/323:17:223
560399140,12cyclictest0-21swapper/321:31:023
560399140,12cyclictest0-21swapper/320:30:133
5602991411,2cyclictest25432-21kworker/u8:021:13:052
5602991411,2cyclictest23499-21kworker/u8:000:26:012
5602991411,2cyclictest17461-21kworker/u8:219:54:052
5602991411,2cyclictest15101-21kworker/u8:219:20:052
560299140,3cyclictest6955-21sh23:06:572
560299140,2cyclictest0-21swapper/223:01:042
560299140,2cyclictest0-21swapper/221:35:342
560299140,12cyclictest0-21swapper/223:20:542
5601991411,2cyclictest21854-21diskmemload23:14:391
5601991411,2cyclictest0-21swapper/123:55:091
5601991411,2cyclictest0-21swapper/121:26:531
560199140,2cyclictest0-21swapper/122:10:191
560199140,13cyclictest0-21swapper/122:16:181
560199140,12cyclictest0-21swapper/122:46:011
560099141,2cyclictest3360-21irqstats22:30:170
560099141,2cyclictest22282-21ssh23:55:540
5600991410,2cyclictest881-21grep20:15:260
560099140,12cyclictest0-21swapper/021:39:260
560099140,12cyclictest0-21swapper/000:33:540
210862140,2sleep00-21swapper/021:05:220
75822130,2sleep00-21swapper/023:07:560
560399138,3cyclictest0-21swapper/319:50:203
5603991310,2cyclictest0-21swapper/323:06:233
5603991310,2cyclictest0-21swapper/322:19:423
5603991310,2cyclictest0-21swapper/322:10:113
5603991310,2cyclictest0-21swapper/321:43:523
5603991310,2cyclictest0-21swapper/300:35:153
560399130,2cyclictest0-21swapper/322:25:173
560399130,2cyclictest0-21swapper/321:35:023
560399130,2cyclictest0-21swapper/321:15:123
560399130,2cyclictest0-21swapper/321:10:493
560399130,2cyclictest0-21swapper/320:25:203
560399130,2cyclictest0-21swapper/319:10:233
560399130,12cyclictest0-21swapper/321:25:183
560399130,12cyclictest0-21swapper/320:40:143
560399130,12cyclictest0-21swapper/300:26:023
560399130,12cyclictest0-21swapper/300:23:533
5602991310,2cyclictest0-21swapper/220:20:232
5602991310,2cyclictest0-21swapper/219:35:232
560299130,2cyclictest0-21swapper/220:19:042
560299130,2cyclictest0-21swapper/200:36:042
560299130,12cyclictest0-21swapper/222:30:192
560299130,12cyclictest0-21swapper/221:50:032
560299130,12cyclictest0-21swapper/220:55:242
560299130,12cyclictest0-21swapper/200:00:252
560199138,3cyclictest0-21swapper/120:35:151
560199131,11cyclictest21854-21diskmemload21:21:161
5601991310,2cyclictest21854-21diskmemload00:25:021
5601991310,2cyclictest0-21swapper/123:15:181
5601991310,2cyclictest0-21swapper/123:06:091
5601991310,2cyclictest0-21swapper/122:30:261
5601991310,2cyclictest0-21swapper/122:26:431
5601991310,2cyclictest0-21swapper/122:08:071
5601991310,2cyclictest0-21swapper/121:40:581
5601991310,2cyclictest0-21swapper/100:36:521
5601991310,2cyclictest0-21swapper/100:10:171
560199130,2cyclictest0-21swapper/123:51:191
560199130,2cyclictest0-21swapper/122:02:391
560199130,2cyclictest0-21swapper/120:10:171
560199130,12cyclictest0-21swapper/123:44:201
560199130,12cyclictest0-21swapper/122:51:381
560199130,12cyclictest0-21swapper/121:58:481
560199130,12cyclictest0-21swapper/121:45:221
560199130,12cyclictest0-21swapper/121:30:171
560199130,12cyclictest0-21swapper/120:05:231
560199130,12cyclictest0-21swapper/100:17:381
560199130,12cyclictest0-21swapper/100:01:581
560199130,11cyclictest0-21swapper/100:20:321
560199130,11cyclictest0-21swapper/100:05:381
5600991310,2cyclictest19137-21smartctl19:40:260
5600991310,2cyclictest0-21swapper/023:38:260
5600991310,2cyclictest0-21swapper/022:55:060
5600991310,2cyclictest0-21swapper/021:42:150
5600991310,2cyclictest0-21swapper/021:21:350
5600991310,2cyclictest0-21swapper/000:35:160
5600991310,2cyclictest0-21swapper/000:27:240
5600991310,2cyclictest0-21swapper/000:12:350
560099130,2cyclictest0-21swapper/023:28:250
560099130,2cyclictest0-21swapper/019:45:150
560099130,12cyclictest0-21swapper/023:45:150
560099130,11cyclictest0-21swapper/022:45:250
560099130,11cyclictest0-21swapper/000:05:450
277532130,2sleep10-21swapper/121:15:171
560399129,2cyclictest0-21swapper/323:39:533
560399129,2cyclictest0-21swapper/322:31:183
560399129,2cyclictest0-21swapper/321:21:043
560399129,2cyclictest0-21swapper/320:46:183
560399129,2cyclictest0-21swapper/320:35:143
560399129,2cyclictest0-21swapper/319:35:153
560399128,2cyclictest7492-21ssh00:15:113
560399122,7cyclictest0-21swapper/320:52:013
560399120,7cyclictest0-21swapper/321:10:003
560399120,2cyclictest0-21swapper/323:13:483
560399120,2cyclictest0-21swapper/322:47:043
560399120,2cyclictest0-21swapper/322:00:033
560399120,2cyclictest0-21swapper/321:51:303
560399120,2cyclictest0-21swapper/319:40:203
560399120,11cyclictest0-21swapper/322:51:113
560399120,11cyclictest0-21swapper/321:45:393
560399120,11cyclictest0-21swapper/319:45:203
560399120,11cyclictest0-21swapper/300:30:323
560299129,2cyclictest17461-21kworker/u8:220:02:042
560299129,2cyclictest0-21swapper/220:30:262
5602991210,1cyclictest0-21swapper/221:40:072
560299120,2cyclictest0-21swapper/219:40:172
560199129,2cyclictest0-21swapper/123:31:531
560199129,2cyclictest0-21swapper/120:30:201
560199129,2cyclictest0-21swapper/120:20:231
560199129,2cyclictest0-21swapper/119:35:121
560199127,3cyclictest13766-21munin-run19:30:001
560199124,6cyclictest0-21swapper/123:35:121
560199121,9cyclictest0-21swapper/119:45:201
560199120,2cyclictest0-21swapper/123:00:171
560199120,11cyclictest0-21swapper/123:25:121
560199120,11cyclictest0-21swapper/123:21:041
560199120,11cyclictest0-21swapper/120:55:131
560199120,11cyclictest0-21swapper/120:25:191
560199120,10cyclictest0-21swapper/122:35:211
560199120,10cyclictest0-21swapper/100:30:121
560099129,2cyclictest21854-21diskmemload23:30:040
560099129,2cyclictest0-21swapper/022:41:450
560099129,2cyclictest0-21swapper/022:27:150
560099129,2cyclictest0-21swapper/022:00:060
560099122,7cyclictest604-21ssh23:00:230
560099122,7cyclictest0-21swapper/020:21:010
560099122,7cyclictest0-21swapper/019:30:580
560099122,7cyclictest0-21swapper/000:22:010
560099122,7cyclictest0-21swapper/000:02:020
560099120,2cyclictest0-21swapper/023:15:040
560099120,2cyclictest0-21swapper/022:21:160
560099120,2cyclictest0-21swapper/022:21:150
560099120,2cyclictest0-21swapper/021:29:250
560099120,2cyclictest0-21swapper/020:25:170
560099120,2cyclictest0-21swapper/000:16:050
560099120,11cyclictest21854-21diskmemload23:43:440
560099120,11cyclictest0-21swapper/023:50:440
560099120,11cyclictest0-21swapper/023:13:250
560099120,11cyclictest0-21swapper/022:50:150
560099120,11cyclictest0-21swapper/022:37:150
560099120,11cyclictest0-21swapper/021:57:140
560099120,11cyclictest0-21swapper/021:50:050
560099120,11cyclictest0-21swapper/020:35:160
560399118,2cyclictest0-21swapper/320:05:183
560299112,7cyclictest0-21swapper/220:41:582
560299112,6cyclictest0-21swapper/221:02:592
560199117,2cyclictest0-21swapper/119:40:171
560199112,5cyclictest0-21swapper/120:49:591
560199111,6cyclictest0-21swapper/119:55:251
560199111,5cyclictest0-21swapper/119:55:001
560199110,9cyclictest0-21swapper/119:15:101
560199110,9cyclictest0-21swapper/119:10:171
560199110,10cyclictest0-21swapper/120:40:191
560099118,2cyclictest0-21swapper/020:05:140
560099112,6cyclictest0-21swapper/021:13:590
560099110,2cyclictest0-21swapper/019:15:160
560099110,10cyclictest0-21swapper/023:21:260
92362105,2sleep00-21swapper/021:30:070
560399107,2cyclictest0-21swapper/320:55:293
560399102,6cyclictest0-21swapper/320:15:243
560399102,6cyclictest0-21swapper/320:10:243
560199107,2cyclictest0-21swapper/120:00:141
560199103,5cyclictest0-21swapper/121:05:411
560199101,8cyclictest0-21swapper/119:30:191
560099107,2cyclictest0-21swapper/022:16:360
560099107,2cyclictest0-21swapper/020:00:170
560099102,6cyclictest0-21swapper/020:34:580
560099102,5cyclictest0-21swapper/020:46:020
560099102,5cyclictest0-21swapper/019:55:580
560099100,2cyclictest0-21swapper/021:19:390
56039994,3cyclictest7964-21basename19:15:113
56039994,3cyclictest12287-21df_abs19:25:143
56039991,6cyclictest0-21swapper/320:00:253
56019994,3cyclictest12383-21sed20:45:141
56019990,7cyclictest0-21swapper/120:15:181
56009992,4cyclictest0-21swapper/020:13:590
56009992,4cyclictest0-21swapper/019:27:010
56009990,2cyclictest0-21swapper/020:55:210
25540290,2sleep30-21swapper/319:56:153
56039983,3cyclictest139742sleep319:30:103
56019981,3cyclictest13589-21kworker/u8:121:00:141
56009984,3cyclictest10240-21cpuspeed_turbos20:40:120
56009983,3cyclictest5129-21runrttasks19:10:110
56009983,3cyclictest11913-21latency_hist19:25:010
56009982,5cyclictest0-21swapper/019:52:580
56009980,6cyclictest0-21swapper/020:50:380
56009980,2cyclictest198312sleep021:04:580
56009971,5cyclictest0-21swapper/019:35:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional