You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 13:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Sun Dec 14, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17400212095,18sleep00-21swapper/019:05:150
18100211193,12sleep20-21swapper/219:07:372
17279210779,20sleep30-21swapper/319:05:143
1795529887,6sleep10-21swapper/119:05:441
58972800,1sleep05898-21sh21:47:360
14352760,0sleep30-21swapper/321:43:023
134542340,2sleep013450-21ssh23:05:000
18313992910,2cyclictest0-21swapper/022:10:110
18313992910,2cyclictest0-21swapper/022:10:100
269272270,0sleep30-21swapper/322:45:003
18313992617,7cyclictest0-21swapper/022:40:140
310092250,0sleep10-21swapper/123:57:371
24132240,1sleep10-21swapper/123:26:531
68112220,1sleep2301ktimersoftd/222:23:022
292432220,1sleep2301ktimersoftd/221:38:092
1831599211,18cyclictest0-21swapper/219:35:132
1831599210,2cyclictest0-21swapper/220:45:152
18315992017,2cyclictest0-21swapper/200:00:102
1831599200,18cyclictest0-21swapper/222:40:142
1831499200,2cyclictest0-21swapper/123:45:121
1831499200,2cyclictest0-21swapper/121:10:111
1831499200,2cyclictest0-21swapper/100:05:131
120372180,0sleep30-21swapper/321:54:423
223472170,1sleep10-21swapper/122:40:001
1831599171,13cyclictest0-21swapper/222:25:052
18316991613,2cyclictest0-21swapper/323:25:133
18316991612,2cyclictest0-21swapper/323:10:123
18315991612,2cyclictest1953-21diskmemload22:35:112
1831499160,14cyclictest0-21swapper/122:48:541
1831399161,13cyclictest0-21swapper/022:25:120
1831399160,14cyclictest2990-21ssh23:27:500
1831399160,14cyclictest0-21swapper/023:08:510
1831699151,3cyclictest0-21swapper/323:38:533
1831599152,7cyclictest12337-21ssh21:55:012
1831599151,12cyclictest0-21swapper/222:00:302
18315991510,3cyclictest28371-21sh00:30:022
1831599150,13cyclictest0-21swapper/223:16:032
1831599150,13cyclictest0-21swapper/222:30:242
1831599150,13cyclictest0-21swapper/221:55:112
1831599150,13cyclictest0-21swapper/200:25:122
18314991511,2cyclictest0-21swapper/122:14:241
18314991511,2cyclictest0-21swapper/122:14:241
1831499150,2cyclictest0-21swapper/100:27:531
1831399151,12cyclictest2238-21ssh21:10:080
18313991510,3cyclictest0-21swapper/021:57:190
1831399150,13cyclictest0-21swapper/023:19:300
1831699149,3cyclictest24016-21grep23:50:143
18316991410,3cyclictest30607-21apt-get19:40:123
18316991410,2cyclictest0-21swapper/300:34:543
1831699140,12cyclictest0-21swapper/320:20:123
1831599142,7cyclictest0-21swapper/221:00:002
1831599141,11cyclictest1953-21diskmemload23:47:112
18315991410,2cyclictest6150-21ssh00:05:222
18315991410,2cyclictest13380-21ps20:15:182
1831599140,3cyclictest31056-21ssh22:49:052
1831599140,2cyclictest0-21swapper/223:10:112
1831599140,2cyclictest0-21swapper/219:20:122
1831599140,12cyclictest1953-21diskmemload23:25:252
1831599140,12cyclictest1953-21diskmemload23:21:332
1831599140,12cyclictest0-21swapper/223:05:242
1831599140,12cyclictest0-21swapper/222:52:022
18314991411,2cyclictest0-21swapper/123:00:431
18314991411,2cyclictest0-21swapper/122:18:341
18314991411,2cyclictest0-21swapper/122:18:331
18314991411,2cyclictest0-21swapper/122:02:341
18314991411,2cyclictest0-21swapper/100:32:441
18314991411,2cyclictest0-21swapper/100:10:541
1831499140,2cyclictest0-21swapper/123:12:141
1831499140,2cyclictest0-21swapper/120:25:241
1831499140,13cyclictest1953-21diskmemload22:41:141
1831499140,12cyclictest12185-21apt-get20:15:051
1831499140,12cyclictest0-21swapper/123:50:431
1831499140,12cyclictest0-21swapper/122:26:431
1831399149,3cyclictest2484-21df_abs19:50:140
1831399149,3cyclictest12797-21df_abs20:15:140
1831399149,3cyclictest10198-21kernelversion23:35:170
1831399149,3cyclictest0-21swapper/022:20:140
1831399144,8cyclictest277-21jbd2/sda1-822:40:000
1831399142,7cyclictest0-21swapper/020:05:000
1831399142,6cyclictest0-21swapper/020:41:590
1831399141,2cyclictest702-21apt-get00:35:130
18313991411,2cyclictest0-21swapper/021:33:010
18313991411,2cyclictest0-21swapper/000:08:100
1831399140,2cyclictest0-21swapper/022:00:310
1831399140,12cyclictest22631-21sh23:49:090
1831399140,12cyclictest14728-21egrep00:15:130
1831399140,12cyclictest0-21swapper/022:18:530
1831399140,12cyclictest0-21swapper/022:18:520
18316991310,2cyclictest1953-21diskmemload00:00:133
18316991310,2cyclictest0-21swapper/323:45:343
18316991310,2cyclictest0-21swapper/323:34:543
18316991310,2cyclictest0-21swapper/321:31:333
1831699130,2cyclictest142742chrt21:55:423
1831699130,2cyclictest0-21swapper/322:15:343
1831699130,2cyclictest0-21swapper/322:15:343
1831699130,12cyclictest28332-21ssh23:20:143
1831699130,11cyclictest0-21swapper/321:18:583
1831699130,11cyclictest0-21swapper/319:35:263
1831599139,2cyclictest0-21swapper/222:10:102
1831599139,2cyclictest0-21swapper/222:10:102
18315991310,2cyclictest1953-21diskmemload22:15:422
18315991310,2cyclictest1953-21diskmemload22:15:412
18315991310,2cyclictest0-21swapper/221:00:142
18315991310,2cyclictest0-21swapper/200:14:332
1831599130,2cyclictest0-21swapper/223:57:232
1831599130,2cyclictest0-21swapper/223:36:362
1831599130,2cyclictest0-21swapper/223:33:432
1831599130,2cyclictest0-21swapper/221:42:032
1831599130,2cyclictest0-21swapper/221:28:222
1831599130,12cyclictest0-21swapper/223:54:512
1831599130,11cyclictest0-21swapper/200:17:522
18314991310,2cyclictest0-21swapper/123:34:381
18314991310,2cyclictest0-21swapper/122:32:091
18314991310,2cyclictest0-21swapper/121:53:501
18314991310,2cyclictest0-21swapper/121:49:071
18314991310,2cyclictest0-21swapper/121:40:571
18314991310,2cyclictest0-21swapper/121:35:041
18314991310,2cyclictest0-21swapper/100:02:341
1831499130,2cyclictest0-21swapper/123:35:091
1831499130,2cyclictest0-21swapper/123:22:481
1831499130,2cyclictest0-21swapper/122:05:191
1831499130,2cyclictest0-21swapper/121:31:131
1831499130,2cyclictest0-21swapper/121:26:181
1831499130,12cyclictest8766-21ssh21:15:281
1831499130,12cyclictest0-21swapper/123:43:181
1831499130,12cyclictest0-21swapper/123:05:231
1831499130,12cyclictest0-21swapper/122:50:261
1831499130,12cyclictest0-21swapper/121:21:041
1831499130,12cyclictest0-21swapper/100:37:031
1831499130,12cyclictest0-21swapper/100:20:161
1831499130,12cyclictest0-21swapper/100:15:031
1831399138,3cyclictest0-21swapper/020:45:290
1831399131,6cyclictest0-21swapper/023:00:010
18313991310,2cyclictest0-21swapper/022:30:560
18313991310,2cyclictest0-21swapper/021:44:110
18313991310,2cyclictest0-21swapper/000:12:130
1831399130,2cyclictest32627-21apt-get21:05:140
1831399130,2cyclictest0-21swapper/022:45:280
1831399130,2cyclictest0-21swapper/021:39:130
1831399130,2cyclictest0-21swapper/021:21:300
1831399130,2cyclictest0-21swapper/000:30:130
1831399130,2cyclictest0-21swapper/000:20:190
1831399130,12cyclictest0-21swapper/023:13:200
1831399130,12cyclictest0-21swapper/022:53:200
1831399130,12cyclictest0-21swapper/000:04:110
1831399130,11cyclictest1953-21diskmemload23:40:490
1831399130,11cyclictest0-21swapper/023:56:420
8282121,8sleep1951-21cat19:45:181
1831699129,2cyclictest2326-21kworker/u8:020:06:043
1831699129,2cyclictest0-21swapper/320:00:133
1831699129,2cyclictest0-21swapper/300:11:543
1831699123,7cyclictest0-21swapper/321:46:213
1831699121,9cyclictest7732-21sshd22:24:183
1831699120,11cyclictest8676-21kworker/u8:022:28:043
1831699120,11cyclictest0-21swapper/323:17:343
1831699120,11cyclictest0-21swapper/321:27:143
1831699120,11cyclictest0-21swapper/321:05:233
1831699120,11cyclictest0-21swapper/320:50:133
1831699120,11cyclictest0-21swapper/319:10:143
1831699120,10cyclictest0-21swapper/323:55:203
1831699120,10cyclictest0-21swapper/322:36:223
1831699120,10cyclictest0-21swapper/321:39:263
1831699120,10cyclictest0-21swapper/319:19:563
1831599129,2cyclictest0-21swapper/223:40:192
1831599129,2cyclictest0-21swapper/221:45:192
1831599129,2cyclictest0-21swapper/221:30:192
1831599129,2cyclictest0-21swapper/221:10:572
1831599129,2cyclictest0-21swapper/220:25:102
1831599129,2cyclictest0-21swapper/219:55:142
1831599129,2cyclictest0-21swapper/200:20:022
1831599120,2cyclictest0-21swapper/221:15:302
1831599120,11cyclictest0-21swapper/223:00:052
1831599120,11cyclictest0-21swapper/222:55:202
1831599120,11cyclictest0-21swapper/222:07:502
1831599120,11cyclictest0-21swapper/221:21:142
1831599120,11cyclictest0-21swapper/221:05:262
1831599120,11cyclictest0-21swapper/219:45:132
1831599120,11cyclictest0-21swapper/219:25:132
1831599120,11cyclictest0-21swapper/200:36:372
1831499129,2cyclictest0-21swapper/123:15:491
1831499129,2cyclictest0-21swapper/121:55:221
1831499129,2cyclictest0-21swapper/119:25:171
1831499120,2cyclictest0-21swapper/119:20:241
1831499120,11cyclictest0-21swapper/122:55:091
1831499120,11cyclictest0-21swapper/120:46:201
1831499120,11cyclictest0-21swapper/120:00:261
1831499120,10cyclictest0-21swapper/122:20:241
1831499120,10cyclictest0-21swapper/120:50:221
1831499120,10cyclictest0-21swapper/120:20:221
1831499120,10cyclictest0-21swapper/120:10:191
1831499120,10cyclictest0-21swapper/119:50:201
1831399129,2cyclictest0-21swapper/023:52:320
1831399129,2cyclictest0-21swapper/023:30:450
1831399129,2cyclictest0-21swapper/021:50:450
1831399129,2cyclictest0-21swapper/019:55:120
1831399129,2cyclictest0-21swapper/019:40:120
1831399121,8cyclictest0-21swapper/020:56:580
18313991210,1cyclictest0-21swapper/019:45:180
1831399120,2cyclictest0-21swapper/019:30:130
1831399120,11cyclictest0-21swapper/023:20:530
1831399120,11cyclictest0-21swapper/022:06:130
1831399120,11cyclictest0-21swapper/021:27:470
1831399120,11cyclictest0-21swapper/021:15:160
1831399120,11cyclictest0-21swapper/020:50:250
1831399120,11cyclictest0-21swapper/020:30:200
1831399120,11cyclictest0-21swapper/020:25:240
1831399120,11cyclictest0-21swapper/020:10:140
1831399120,11cyclictest0-21swapper/000:27:240
167062120,2sleep30-21swapper/323:07:493
30962110,2sleep30-21swapper/300:36:513
19502111,7sleep31958-21ssh22:51:583
1831699118,2cyclictest0-21swapper/322:14:023
1831699118,2cyclictest0-21swapper/322:14:023
1831699118,2cyclictest0-21swapper/320:30:203
1831699112,7cyclictest7427-21metacity19:52:593
1831699112,7cyclictest0-21swapper/320:15:023
1831699111,8cyclictest3235-21munin-node3
1831699111,8cyclictest0-21swapper/322:33:593
1831699110,9cyclictest0-21swapper/321:20:183
1831699110,1cyclictest1953-21diskmemload00:07:553
1831699110,10cyclictest0-21swapper/319:30:173
1831599118,2cyclictest0-21swapper/220:41:192
1831599112,5cyclictest12235-21copy20:15:002
1831599111,6cyclictest0-21swapper/219:45:002
1831499118,2cyclictest0-21swapper/121:00:241
1831499118,2cyclictest0-21swapper/119:15:211
1831499117,2cyclictest0-21swapper/119:10:101
1831499110,2cyclictest0-21swapper/120:05:231
1831499110,10cyclictest0-21swapper/120:30:021
1831499110,10cyclictest0-21swapper/119:55:221
1831499110,10cyclictest0-21swapper/119:40:181
1831399118,2cyclictest0-21swapper/019:15:270
1831399113,6cyclictest0-21swapper/021:00:240
1831399110,10cyclictest0-21swapper/020:35:260
1831399110,10cyclictest0-21swapper/019:25:210
1831699105,3cyclictest28153-21turbostat00:29:593
1831699105,3cyclictest14516-21ssh00:15:133
1831699104,5cyclictest0-21swapper/322:45:223
1831699104,4cyclictest10345-21grep23:00:253
1831699104,4cyclictest0-21swapper/322:59:593
1831699104,3cyclictest6528-21ntpd22:03:403
1831699102,7cyclictest0-21swapper/320:13:593
1831699101,7cyclictest0-21swapper/319:24:563
1831699100,9cyclictest0-21swapper/323:42:543
1831699100,1cyclictest0-21swapper/322:06:123
1831599107,2cyclictest0-21swapper/219:52:122
1831599107,2cyclictest0-21swapper/219:15:242
1831599105,3cyclictest28358-21cron19:35:012
1831599105,3cyclictest21431-21grep20:35:182
1831599105,3cyclictest18937-21grep19:10:112
1831599100,6cyclictest0-21swapper/220:05:252
1831499107,2cyclictest0-21swapper/120:35:091
1831499102,6cyclictest0-21swapper/120:57:351
1831499100,9cyclictest18622-21kworker/u8:019:35:041
1831499100,9cyclictest16200-21kworker/u8:021:08:031
155092100,2sleep00-21swapper/020:20:230
183169994,3cyclictest944-21missed_timers19:45:183
183169994,3cyclictest7458-21runrttasks20:25:123
183169994,3cyclictest25176-21rm20:45:193
183169994,3cyclictest24847-21grep19:25:123
183169994,3cyclictest20839-21tr20:35:133
183169994,3cyclictest19286-21ssh00:20:133
183169993,4cyclictest30741-21aten2.4-expect21:00:133
183169991,6cyclictest0-21swapper/320:40:213
183169990,7cyclictest0-21swapper/319:56:593
183159994,3cyclictest7641-21wc20:00:252
183159994,3cyclictest277-21jbd2/sda1-820:30:072
183159994,3cyclictest26879-21cpuspeed_turbos20:50:142
183159991,6cyclictest14779-21cut20:20:132
183149996,2cyclictest0-21swapper/120:40:161
183149990,2cyclictest26572-21munin-node1
183139996,2cyclictest0-21swapper/019:21:200
183139994,3cyclictest19473-21grep19:10:150
183139994,3cyclictest10176-21cron20:09:590
183139992,6cyclictest0-21swapper/019:35:250
183169981,3cyclictest0-21swapper/320:55:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional