You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 11:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Tue Dec 23, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24323211897,16sleep00-21swapper/019:07:060
24197211795,15sleep20-21swapper/219:05:282
244062116105,6sleep30-21swapper/319:08:093
2423129988,6sleep10-21swapper/119:05:551
67842850,1sleep00-21swapper/021:05:120
111952830,2sleep311194-21ssh00:20:003
12332800,0sleep20-21swapper/223:30:172
213852730,0sleep30-21swapper/322:00:353
159302730,0sleep00-21swapper/021:18:030
39012710,1sleep00-21swapper/023:33:430
201822710,0sleep30-21swapper/321:22:513
78202540,1sleep27798-21ssh00:15:182
24579993716,19cyclictest0-21swapper/019:15:110
24581992421,2cyclictest0-21swapper/219:55:002
24579992320,2cyclictest0-21swapper/019:55:020
283402210,0sleep00-21swapper/022:46:050
2458199210,19cyclictest0-21swapper/220:55:142
2457999200,18cyclictest0-21swapper/023:45:110
2457999200,18cyclictest0-21swapper/020:55:130
2457999200,18cyclictest0-21swapper/019:40:100
274672180,1sleep027465-21if_eth020:35:150
24583991815,2cyclictest24589-21kworker/u8:023:46:063
2458399170,15cyclictest0-21swapper/323:53:503
2458399161,13cyclictest20903-21ssh22:38:203
2458399160,3cyclictest30677-21cat00:05:013
2458399160,14cyclictest4311-21vmstat22:55:293
2458399160,14cyclictest4311-21vmstat22:55:283
2458399160,14cyclictest0-21swapper/323:26:003
2458399160,14cyclictest0-21swapper/322:51:003
2458099160,2cyclictest0-21swapper/123:14:121
2458099160,14cyclictest8451-21diskmemload21:34:221
2458099160,14cyclictest0-21swapper/100:39:331
2458099160,14cyclictest0-21swapper/100:23:031
2457999161,3cyclictest0-21swapper/020:45:160
24579991613,2cyclictest8294-21kworker/u8:021:13:040
24579991613,2cyclictest4864-21kworker/u8:122:27:040
24579991613,2cyclictest26659-21kworker/u8:200:09:040
2457999160,2cyclictest0-21swapper/022:20:040
2457999160,14cyclictest0-21swapper/022:05:440
24583991512,2cyclictest0-21swapper/322:46:303
24583991512,2cyclictest0-21swapper/320:10:203
24583991512,2cyclictest0-21swapper/300:05:203
2458399151,12cyclictest6747-21kworker/u8:123:40:023
2458399150,13cyclictest0-21swapper/322:44:143
2458399150,13cyclictest0-21swapper/322:28:283
2458399150,13cyclictest0-21swapper/322:24:423
2458399150,13cyclictest0-21swapper/322:10:213
2458399150,13cyclictest0-21swapper/321:52:403
2458399150,13cyclictest0-21swapper/321:37:533
2458399150,13cyclictest0-21swapper/319:10:123
2458399150,13cyclictest0-21swapper/300:31:123
2458399150,13cyclictest0-21swapper/300:31:113
2458399150,13cyclictest0-21swapper/300:21:343
24581991510,3cyclictest0-21swapper/220:45:172
2458199150,13cyclictest0-21swapper/222:53:562
2458199150,13cyclictest0-21swapper/221:53:152
2458199150,13cyclictest0-21swapper/200:02:162
2458099151,3cyclictest817-21df20:50:151
2458099151,2cyclictest0-21swapper/120:10:141
24580991512,2cyclictest0-21swapper/122:25:521
2458099151,12cyclictest9051-21df19:50:141
24580991511,2cyclictest221ktimersoftd/100:17:431
2458099150,2cyclictest0-21swapper/123:50:131
2458099150,2cyclictest0-21swapper/122:04:021
2458099150,14cyclictest0-21swapper/123:28:531
2458099150,14cyclictest0-21swapper/121:35:121
2458099150,14cyclictest0-21swapper/121:13:421
2458099150,13cyclictest8451-21diskmemload22:55:331
2458099150,13cyclictest8451-21diskmemload22:55:331
24579991512,2cyclictest8451-21diskmemload00:25:240
24579991512,2cyclictest3638-21kworker/0:221:44:040
24579991512,2cyclictest25978-21kworker/u8:022:42:040
24579991512,2cyclictest11599-21kworker/u8:223:20:040
24579991512,2cyclictest0-21swapper/023:12:340
2457999151,12cyclictest23062-21ssh00:33:290
2457999151,12cyclictest23062-21ssh00:33:290
2457999150,2cyclictest0-21swapper/000:18:350
160462151,3sleep116056-21ssh21:18:171
76932140,2sleep10-21swapper/123:37:351
24583991411,2cyclictest0-21swapper/323:37:053
24583991411,2cyclictest0-21swapper/323:09:393
24583991411,2cyclictest0-21swapper/323:09:393
24583991411,2cyclictest0-21swapper/322:09:403
24583991411,2cyclictest0-21swapper/321:56:003
24583991411,2cyclictest0-21swapper/321:46:543
24583991411,2cyclictest0-21swapper/321:26:333
24583991411,2cyclictest0-21swapper/320:15:193
24583991411,2cyclictest0-21swapper/320:15:183
2458399140,3cyclictest0-21swapper/321:10:133
2458399140,2cyclictest0-21swapper/322:16:193
2458399140,2cyclictest0-21swapper/321:40:193
2458399140,13cyclictest0-21swapper/323:30:103
2458399140,13cyclictest0-21swapper/323:03:503
2458399140,13cyclictest0-21swapper/321:32:433
2458399140,12cyclictest16038-21diskstats00:25:153
2458399140,12cyclictest0-21swapper/323:55:023
2458399140,12cyclictest0-21swapper/323:10:443
2458399140,12cyclictest0-21swapper/322:31:053
2458399140,12cyclictest0-21swapper/320:05:153
2458399140,12cyclictest0-21swapper/319:55:203
2458399140,12cyclictest0-21swapper/300:35:033
2458199149,3cyclictest21579-21cat20:20:162
2458199149,3cyclictest0-21swapper/223:55:212
24581991411,2cyclictest8451-21diskmemload23:15:142
24581991411,2cyclictest0-21swapper/220:15:002
24581991411,2cyclictest0-21swapper/220:15:002
2458199140,12cyclictest0-21swapper/222:16:152
2458199140,12cyclictest0-21swapper/221:10:232
2458199140,12cyclictest0-21swapper/200:31:152
2458199140,12cyclictest0-21swapper/200:31:152
24580991411,2cyclictest0-21swapper/123:58:231
24580991411,2cyclictest0-21swapper/123:15:221
24580991411,2cyclictest0-21swapper/122:07:421
24580991411,2cyclictest0-21swapper/121:27:191
24580991411,2cyclictest0-21swapper/119:10:161
24580991410,3cyclictest221ktimersoftd/121:21:201
2458099140,2cyclictest8451-21diskmemload23:34:001
2458099140,2cyclictest0-21swapper/122:10:131
2458099140,2cyclictest0-21swapper/100:00:041
2458099140,13cyclictest8451-21diskmemload00:05:351
2458099140,13cyclictest0-21swapper/121:58:421
2458099140,13cyclictest0-21swapper/121:45:281
2458099140,13cyclictest0-21swapper/121:44:091
2458099140,12cyclictest0-21swapper/123:24:351
2458099140,12cyclictest0-21swapper/123:07:541
2458099140,12cyclictest0-21swapper/123:07:531
2458099140,12cyclictest0-21swapper/121:00:211
2458099140,12cyclictest0-21swapper/120:15:181
2458099140,12cyclictest0-21swapper/120:15:181
2458099140,12cyclictest0-21swapper/100:13:341
24579991411,2cyclictest8451-21diskmemload23:02:340
2457999140,9cyclictest0-21swapper/019:21:030
2457999140,3cyclictest20613-21latency_hist20:20:000
2457999140,3cyclictest20613-21latency_hist20:20:000
2457999140,3cyclictest0-21swapper/022:10:190
2457999140,2cyclictest0-21swapper/022:03:440
2457999140,2cyclictest0-21swapper/021:25:140
2457999140,13cyclictest0-21swapper/022:33:440
2457999140,13cyclictest0-21swapper/022:16:340
2457999140,12cyclictest6675-21snmpd00:01:480
2457999140,12cyclictest0-21swapper/021:48:480
226042140,3sleep20-21swapper/221:25:192
24583991310,2cyclictest0-21swapper/320:50:203
24583991310,2cyclictest0-21swapper/319:20:143
2458399130,2cyclictest0-21swapper/319:45:183
2458399130,2cyclictest0-21swapper/300:10:103
2458399130,12cyclictest0-21swapper/323:21:263
2458399130,12cyclictest0-21swapper/323:15:023
2458399130,12cyclictest0-21swapper/321:15:113
2458399130,12cyclictest0-21swapper/320:30:013
2458399130,12cyclictest0-21swapper/319:30:163
2458399130,12cyclictest0-21swapper/319:15:153
24581991310,2cyclictest8451-21diskmemload22:13:432
24581991310,2cyclictest8451-21diskmemload22:01:332
24581991310,2cyclictest0-21swapper/223:45:462
24581991310,2cyclictest0-21swapper/221:47:092
24581991310,2cyclictest0-21swapper/221:15:422
24581991310,2cyclictest0-21swapper/200:10:352
2458199130,2cyclictest0-21swapper/222:45:212
2458199130,2cyclictest0-21swapper/221:55:192
2458199130,12cyclictest0-21swapper/200:35:162
2458199130,12cyclictest0-21swapper/200:27:352
2458199130,11cyclictest8451-21diskmemload23:52:402
2458199130,11cyclictest8451-21diskmemload22:56:112
2458199130,11cyclictest8451-21diskmemload22:56:112
2458199130,11cyclictest0-21swapper/222:40:322
2458199130,11cyclictest0-21swapper/222:37:002
2458199130,11cyclictest0-21swapper/221:36:242
2458199130,11cyclictest0-21swapper/200:21:332
2458099131,4cyclictest7458-21runrttasks23:45:581
24580991310,2cyclictest8451-21diskmemload23:41:311
24580991310,2cyclictest8451-21diskmemload22:50:001
24580991310,2cyclictest8451-21diskmemload21:50:001
24580991310,2cyclictest0-21swapper/122:45:441
24580991310,2cyclictest0-21swapper/122:30:081
24580991310,2cyclictest0-21swapper/122:20:081
24580991310,2cyclictest0-21swapper/122:15:571
24580991310,2cyclictest0-21swapper/120:05:181
24580991310,2cyclictest0-21swapper/100:30:261
24580991310,2cyclictest0-21swapper/100:30:261
24580991310,2cyclictest0-21swapper/100:28:481
2458099130,2cyclictest8451-21diskmemload22:41:111
24579991310,2cyclictest939-21kworker/u8:019:14:040
24579991310,2cyclictest6683-21kworker/u8:220:02:050
24579991310,2cyclictest577-21kworker/u8:119:37:040
24579991310,2cyclictest24680-21kworker/u8:222:57:050
24579991310,2cyclictest24680-21kworker/u8:222:57:040
24579991310,2cyclictest22885-21kworker/u8:220:41:040
24579991310,2cyclictest0-21swapper/023:35:040
24579991310,2cyclictest0-21swapper/023:06:350
24579991310,2cyclictest0-21swapper/023:06:340
24579991310,2cyclictest0-21swapper/021:53:480
24579991310,2cyclictest0-21swapper/021:36:250
24579991310,2cyclictest0-21swapper/021:30:110
24579991310,2cyclictest0-21swapper/019:55:000
2457999130,2cyclictest8451-21diskmemload23:40:260
2457999130,2cyclictest29453-21if_eth023:25:160
2457999130,2cyclictest0-21swapper/022:50:160
2457999130,2cyclictest0-21swapper/022:36:550
2457999130,2cyclictest0-21swapper/021:21:490
2457999130,2cyclictest0-21swapper/021:00:190
2457999130,1cyclictest0-21swapper/023:52:450
2457999130,12cyclictest14464-21ssh00:23:240
2457999130,11cyclictest8451-21diskmemload23:15:470
165292130,2sleep00-21swapper/021:55:240
2458399129,2cyclictest0-21swapper/320:37:103
2458199129,2cyclictest0-21swapper/223:10:262
2458199129,2cyclictest0-21swapper/223:06:532
2458199129,2cyclictest0-21swapper/223:06:522
2458199129,2cyclictest0-21swapper/222:31:102
2458199129,2cyclictest0-21swapper/222:21:122
2458199129,2cyclictest0-21swapper/222:06:342
2458199129,2cyclictest0-21swapper/221:23:072
2458199129,2cyclictest0-21swapper/220:35:122
2458199129,2cyclictest0-21swapper/220:25:162
2458199120,2cyclictest8451-21diskmemload23:24:022
2458199120,2cyclictest0-21swapper/221:31:162
2458199120,2cyclictest0-21swapper/200:05:472
2458199120,11cyclictest0-21swapper/223:26:542
2458199120,11cyclictest0-21swapper/223:04:102
2458199120,11cyclictest0-21swapper/221:40:112
2458199120,11cyclictest0-21swapper/219:25:252
2458099129,2cyclictest3549-21python19:35:261
2458099127,3cyclictest29232-21diskstats20:40:141
2458099121,9cyclictest30846-21apt-get20:45:111
2458099121,3cyclictest0-21swapper/119:30:191
2458099121,3cyclictest0-21swapper/119:15:161
2458099120,2cyclictest0-21swapper/123:01:321
2458099120,2cyclictest0-21swapper/122:36:411
2458099120,2cyclictest0-21swapper/120:25:191
2458099120,11cyclictest0-21swapper/121:05:191
2458099120,11cyclictest0-21swapper/119:20:211
2457999129,2cyclictest26659-21kworker/u8:200:10:040
2457999129,2cyclictest10832-21kworker/u8:020:09:040
2457999121,3cyclictest25815-21pzem_power20:30:220
2457999120,2cyclictest0-21swapper/019:25:150
2457999120,2cyclictest0-21swapper/000:35:080
220952120,2sleep00-21swapper/023:55:050
2458199118,2cyclictest0-21swapper/223:44:432
2458199118,2cyclictest0-21swapper/222:25:102
2458199116,3cyclictest25726-21munin-node2
2458199113,6cyclictest0-21swapper/220:40:232
2458199112,7cyclictest0-21swapper/219:17:012
2458199110,9cyclictest0-21swapper/220:55:002
2458199110,10cyclictest0-21swapper/223:37:502
2458199110,10cyclictest0-21swapper/219:30:192
2458099118,2cyclictest0-21swapper/120:55:241
2458099118,2cyclictest0-21swapper/120:30:241
2458099111,8cyclictest30868-21munin-node1
2458099110,9cyclictest0-21swapper/120:35:111
2458099110,2cyclictest0-21swapper/119:45:211
2458099110,10cyclictest10832-21kworker/u8:020:03:041
2458099110,10cyclictest0-21swapper/119:55:151
2457999118,2cyclictest29872-21kworker/u8:019:45:040
2457999118,2cyclictest18454-21kworker/u8:120:25:040
2457999110,7cyclictest0-21swapper/020:10:250
2458399107,2cyclictest0-21swapper/320:29:103
2458399107,2cyclictest0-21swapper/320:24:203
2458399100,9cyclictest0-21swapper/319:37:143
2458199102,5cyclictest0-21swapper/220:09:012
2458199101,7cyclictest0-21swapper/221:04:012
2458199100,6cyclictest0-21swapper/220:00:242
2458099107,2cyclictest0-21swapper/120:20:171
2458099100,9cyclictest0-21swapper/119:40:101
2457999107,2cyclictest0-21swapper/020:50:070
2457999104,4cyclictest6528-21ntpd19:30:130
2457999100,7cyclictest0-21swapper/020:23:590
32331290,2sleep30-21swapper/320:46:133
245839996,2cyclictest29872-21kworker/u8:019:41:043
245839996,2cyclictest0-21swapper/321:00:153
245839996,2cyclictest0-21swapper/320:55:283
245839995,3cyclictest7760-21sensors_fan21:05:243
245839995,2cyclictest30218-21grep20:40:273
245839990,8cyclictest0-21swapper/320:00:113
245839990,2cyclictest0-21swapper/319:50:323
245819996,2cyclictest0-21swapper/221:05:152
245819996,2cyclictest0-21swapper/219:40:112
245819994,3cyclictest17658-21open_inodes20:10:202
245819993,4cyclictest25361-21cut20:30:152
245819991,7cyclictest0-21swapper/219:48:592
245819991,6cyclictest0-21swapper/219:35:562
245819990,7cyclictest0-21swapper/219:52:582
245839980,7cyclictest0-21swapper/319:25:523
245819983,3cyclictest30741-21wc19:25:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional