You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 13:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Tue Dec 16, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16641211997,16sleep10-21swapper/107:06:031
16749211793,19sleep00-21swapper/007:07:270
16617211497,12sleep30-21swapper/307:05:453
16654211292,15sleep20-21swapper/207:06:122
3137621040,0sleep10-21swapper/107:45:121
257652920,2sleep125768-21latency_hist12:09:591
231462780,0sleep00-21swapper/007:25:000
211412770,0sleep00-21swapper/012:04:180
142232760,1sleep20-21swapper/210:40:132
65762710,1sleep00-21swapper/009:15:220
75542680,0sleep30-21swapper/310:31:483
149932680,0sleep20-21swapper/209:25:192
153332670,0sleep20-21swapper/210:04:032
307302650,0sleep10-21swapper/111:36:411
286142500,1sleep328613-21ssh09:40:303
1697499440,18cyclictest0-21swapper/007:25:120
16976994324,18cyclictest0-21swapper/210:30:112
16975993717,18cyclictest0-21swapper/108:05:121
16976993615,19cyclictest0-21swapper/209:30:122
1697499281,19cyclictest0-21swapper/010:55:120
1697499280,18cyclictest0-21swapper/009:00:120
299252240,0sleep30-21swapper/309:00:153
188392240,1sleep20-21swapper/212:39:432
1697799221,19cyclictest817-21diskmemload10:40:113
1697699220,20cyclictest0-21swapper/209:00:122
1697699220,20cyclictest0-21swapper/208:00:132
1697599221,19cyclictest0-21swapper/110:40:121
1697599210,19cyclictest31324-21sh09:45:121
1697799201,17cyclictest0-21swapper/309:10:133
1697799200,18cyclictest0-21swapper/310:45:133
281642190,0sleep20-21swapper/212:11:292
16977991914,3cyclictest30341-21ssh12:15:123
1697799180,16cyclictest0-21swapper/309:50:113
16976991815,2cyclictest30956-21kworker/u8:010:24:042
136262180,0sleep00-21swapper/009:24:310
16977991714,2cyclictest29804-21kworker/u8:107:18:033
16977991714,2cyclictest17330-21kworker/u8:108:34:043
16977991714,2cyclictest12707-21kworker/u8:007:12:043
1697799170,12cyclictest0-21swapper/312:25:033
16976991714,2cyclictest7689-21kworker/u8:111:49:042
16976991714,2cyclictest13154-21kworker/u8:210:47:042
16975991713,2cyclictest260842sleep112:10:121
16977991613,2cyclictest7868-21kworker/u8:010:35:043
16977991613,2cyclictest31989-21kworker/u8:108:24:043
16977991613,2cyclictest26744-21kworker/u8:011:22:043
16977991613,2cyclictest2434-21kworker/u8:211:42:033
16977991613,2cyclictest15049-21kworker/u8:111:27:033
16977991613,2cyclictest15036-21kworker/u8:008:38:043
16977991613,2cyclictest10720-21kworker/u8:012:30:043
1697799161,13cyclictest0-21swapper/311:19:123
1697799161,13cyclictest0-21swapper/311:07:183
1697699161,3cyclictest0-21swapper/207:25:262
16976991613,2cyclictest31989-21kworker/u8:108:08:042
16976991613,2cyclictest25415-21kworker/u8:208:57:042
16976991613,2cyclictest2366-21kworker/u8:207:57:032
1697599160,2cyclictest0-21swapper/109:05:131
1697599160,14cyclictest0-21swapper/111:28:511
16974991611,3cyclictest31028-21chrt10:21:190
1697499160,14cyclictest0-21swapper/012:18:390
230302150,0sleep10-21swapper/110:12:231
1697799151,3cyclictest11080-21munin-run08:15:013
1697799151,3cyclictest11080-21munin-run08:15:013
16977991512,2cyclictest8743-21kworker/u8:009:20:043
16977991512,2cyclictest30472-21kworker/u8:011:55:043
16977991512,2cyclictest25415-21kworker/u8:209:08:043
16977991512,2cyclictest2434-21kworker/u8:211:46:043
16977991512,2cyclictest23395-21kworker/u8:007:33:033
16977991512,2cyclictest22847-21kworker/u8:209:55:043
16977991512,2cyclictest22847-21kworker/u8:209:47:043
16977991512,2cyclictest17330-21kworker/u8:108:50:033
16977991512,2cyclictest10901-21kworker/u8:110:12:043
16977991512,2cyclictest10727-21kworker/u8:208:29:033
1697799150,13cyclictest0-21swapper/311:30:013
1697699151,3cyclictest31478-21basename09:45:132
16976991512,2cyclictest4806-21kworker/u8:111:07:032
16976991512,2cyclictest31989-21kworker/u8:108:19:032
16976991512,2cyclictest19236-21kworker/u8:207:40:042
16976991512,2cyclictest19236-21kworker/u8:207:39:042
16976991512,2cyclictest17330-21kworker/u8:108:32:022
16976991512,2cyclictest14367-21kworker/u8:212:00:042
1697699150,2cyclictest0-21swapper/210:38:042
16975991512,2cyclictest817-21diskmemload09:42:101
1697599151,12cyclictest17806-21apt-get10:45:061
16975991510,4cyclictest817-21diskmemload11:00:161
1697599150,13cyclictest0-21swapper/111:18:301
1697499152,7cyclictest0-21swapper/008:35:000
16974991512,2cyclictest0-21swapper/012:32:180
16974991512,2cyclictest0-21swapper/011:21:390
16974991512,2cyclictest0-21swapper/010:41:590
1697499151,12cyclictest817-21diskmemload12:37:290
16974991510,3cyclictest14182-21ssh09:25:120
1697499150,13cyclictest27434-21ssh10:17:390
1697499150,13cyclictest0-21swapper/011:25:180
1697499150,13cyclictest0-21swapper/011:11:390
1697499150,13cyclictest0-21swapper/011:11:380
16977991411,2cyclictest31989-21kworker/u8:108:16:043
16977991411,2cyclictest30472-21kworker/u8:011:51:033
16977991411,2cyclictest25101-21kworker/u8:112:09:043
16977991411,2cyclictest24715-21kworker/u8:210:26:043
16977991411,2cyclictest23395-21kworker/u8:007:51:043
16977991411,2cyclictest17330-21kworker/u8:108:44:043
16977991411,2cyclictest16230-21kworker/u8:210:08:033
16977991411,2cyclictest14367-21kworker/u8:212:13:043
16977991411,2cyclictest14367-21kworker/u8:212:03:013
16977991411,2cyclictest1209-21kworker/u8:109:16:033
16977991411,2cyclictest10901-21kworker/u8:110:01:043
16977991411,2cyclictest0-21swapper/309:27:563
1697799140,3cyclictest23498-21ssh10:50:233
1697799140,12cyclictest817-21diskmemload10:21:363
16976991411,2cyclictest30510-21kworker/u8:012:23:042
16976991411,2cyclictest23395-21kworker/u8:007:47:042
16976991411,2cyclictest19236-21kworker/u8:207:21:042
16976991411,2cyclictest17330-21kworker/u8:108:43:032
16976991411,2cyclictest14367-21kworker/u8:212:15:032
16976991411,2cyclictest10901-21kworker/u8:110:06:032
1697699140,12cyclictest0-21swapper/212:32:282
1697699140,12cyclictest0-21swapper/211:35:402
1697699140,12cyclictest0-21swapper/209:17:582
16975991410,2cyclictest5526-21nfs4_client11:45:181
1697599140,2cyclictest0-21swapper/111:10:311
1697599140,2cyclictest0-21swapper/111:10:301
1697599140,2cyclictest0-21swapper/110:20:391
1697599140,2cyclictest0-21swapper/109:58:191
1697599140,13cyclictest0-21swapper/111:24:511
1697599140,12cyclictest817-21diskmemload12:21:211
1697599140,12cyclictest5046-21dpkg-query08:00:071
1697599140,12cyclictest0-21swapper/109:34:591
1697499149,3cyclictest0-21swapper/009:31:040
1697499142,7cyclictest0-21swapper/011:40:010
16974991411,2cyclictest817-21diskmemload10:45:180
16974991411,2cyclictest0-21swapper/012:25:190
16974991411,2cyclictest0-21swapper/010:35:190
16974991411,2cyclictest0-21swapper/010:26:090
16974991411,2cyclictest0-21swapper/009:57:480
1697499141,11cyclictest30705-21ssh09:44:270
1697499140,3cyclictest13308-21munin-node0
1697499140,2cyclictest817-21diskmemload11:31:180
1697499140,2cyclictest0-21swapper/008:55:120
1697499140,12cyclictest817-21diskmemload11:01:260
1697499140,12cyclictest0-21swapper/012:13:490
1697499140,12cyclictest0-21swapper/011:51:590
1697499140,12cyclictest0-21swapper/010:01:050
1697499140,12cyclictest0-21swapper/009:38:120
158052140,3sleep115813-21ssh11:57:171
45252130,1sleep00-21swapper/011:45:030
258012131,2sleep2817-21diskmemload10:15:222
16977991310,2cyclictest26149-21kworker/u8:311:36:043
16977991310,2cyclictest2366-21kworker/u8:207:55:033
16977991310,2cyclictest23395-21kworker/u8:007:27:043
16977991310,2cyclictest17330-21kworker/u8:108:55:043
16977991310,2cyclictest0-21swapper/310:55:253
16977991310,2cyclictest0-21swapper/310:16:223
1697799130,2cyclictest0-21swapper/312:22:043
1697799130,2cyclictest0-21swapper/311:10:133
1697799130,2cyclictest0-21swapper/311:10:133
1697799130,2cyclictest0-21swapper/311:01:023
1697799130,2cyclictest0-21swapper/309:36:563
1697799130,12cyclictest0-21swapper/309:31:313
1697799130,12cyclictest0-21swapper/307:40:153
16976991310,2cyclictest8743-21kworker/u8:009:35:042
16976991310,2cyclictest817-21diskmemload10:29:002
16976991310,2cyclictest5168-21kworker/u8:112:29:042
16976991310,2cyclictest31989-21kworker/u8:108:22:042
16976991310,2cyclictest31989-21kworker/u8:108:10:042
16976991310,2cyclictest31989-21kworker/u8:108:10:042
16976991310,2cyclictest31483-21kworker/u8:009:06:032
16976991310,2cyclictest26744-21kworker/u8:010:58:032
16976991310,2cyclictest17330-21kworker/u8:108:47:042
16976991310,2cyclictest15049-21kworker/u8:111:25:032
16976991310,2cyclictest14337-21kworker/u8:109:40:032
16976991310,2cyclictest0-21swapper/211:23:182
16976991310,2cyclictest0-21swapper/207:15:192
1697699130,2cyclictest2766-21ssh09:10:372
1697699130,2cyclictest0-21swapper/211:50:182
1697699130,2cyclictest0-21swapper/211:40:592
1697699130,2cyclictest0-21swapper/208:35:182
1697699130,12cyclictest0-21swapper/209:50:122
1697599132,8cyclictest0-21swapper/108:23:021
16975991310,2cyclictest817-21diskmemload11:05:191
16975991310,2cyclictest0-21swapper/112:39:121
16975991310,2cyclictest0-21swapper/111:50:281
16975991310,2cyclictest0-21swapper/111:43:291
16975991310,2cyclictest0-21swapper/110:30:101
16975991310,2cyclictest0-21swapper/110:28:431
16975991310,2cyclictest0-21swapper/110:08:261
16975991310,2cyclictest0-21swapper/109:18:451
16975991310,2cyclictest0-21swapper/109:12:361
1697599130,3cyclictest817-21diskmemload10:18:191
1697599130,2cyclictest0-21swapper/110:35:351
1697599130,2cyclictest0-21swapper/110:00:261
1697599130,2cyclictest0-21swapper/109:50:161
1697599130,2cyclictest0-21swapper/109:25:181
1697599130,12cyclictest817-21diskmemload12:30:151
1697599130,12cyclictest817-21diskmemload09:23:551
1697599130,12cyclictest0-21swapper/112:19:201
1697599130,12cyclictest0-21swapper/109:36:121
1697599130,11cyclictest0-21swapper/110:54:011
1697599130,11cyclictest0-21swapper/108:10:221
1697599130,11cyclictest0-21swapper/108:10:211
1697499132,6cyclictest0-21swapper/007:15:010
16974991310,2cyclictest817-21diskmemload10:08:050
16974991310,2cyclictest0-21swapper/010:30:100
16974991310,2cyclictest0-21swapper/009:52:030
16974991310,2cyclictest0-21swapper/009:46:410
16974991310,2cyclictest0-21swapper/007:50:180
16974991310,2cyclictest0-21swapper/007:35:150
16974991310,2cyclictest0-21swapper/007:30:140
1697499130,2cyclictest817-21diskmemload12:06:550
1697499130,2cyclictest817-21diskmemload11:05:440
1697499130,2cyclictest0-21swapper/011:40:200
1697499130,2cyclictest0-21swapper/007:59:570
1697499130,12cyclictest0-21swapper/012:24:110
1697499130,12cyclictest0-21swapper/010:51:390
1697499130,12cyclictest0-21swapper/010:10:380
1697499130,12cyclictest0-21swapper/008:40:170
1697799122,7cyclictest0-21swapper/312:35:023
1697699129,2cyclictest2366-21kworker/u8:207:53:042
1697699129,2cyclictest23395-21kworker/u8:007:32:032
1697699129,2cyclictest20494-21kworker/u8:012:05:032
1697699129,2cyclictest0-21swapper/209:57:552
1697699127,3cyclictest30984-21ssh11:00:122
1697699120,2cyclictest0-21swapper/211:31:082
1697699120,2cyclictest0-21swapper/211:18:462
1697699120,11cyclictest0-21swapper/211:12:472
1697699120,11cyclictest0-21swapper/211:12:472
1697699120,11cyclictest0-21swapper/210:50:132
1697699120,11cyclictest0-21swapper/210:11:282
1697599128,2cyclictest0-21swapper/107:10:201
1697599122,7cyclictest7497-21gdm-simple-gree11:31:581
1697599122,7cyclictest0-21swapper/108:31:021
1697599120,2cyclictest27783-21cut10:55:211
1697599120,2cyclictest0-21swapper/112:26:061
1697599120,2cyclictest0-21swapper/108:15:191
1697599120,2cyclictest0-21swapper/107:55:161
1697599120,2cyclictest0-21swapper/107:40:231
1697599120,11cyclictest0-21swapper/112:01:251
1697599120,11cyclictest0-21swapper/108:40:241
1697599120,11cyclictest0-21swapper/107:50:131
1697599120,10cyclictest0-21swapper/108:35:221
1697499129,2cyclictest0-21swapper/011:15:160
1697499122,7cyclictest0-21swapper/008:53:590
1697499122,6cyclictest0-21swapper/008:50:010
1697499121,6cyclictest0-21swapper/009:10:120
1697499120,2cyclictest0-21swapper/008:10:130
1697499120,2cyclictest0-21swapper/008:10:120
1697499120,2cyclictest0-21swapper/008:05:120
1697499120,11cyclictest0-21swapper/008:20:150
1697799118,2cyclictest0-21swapper/308:05:123
1697699118,2cyclictest0-21swapper/209:20:382
1697699112,6cyclictest14514-21ssh11:55:262
1697599118,2cyclictest0-21swapper/108:25:201
1697599112,6cyclictest0-21swapper/108:55:591
1697599111,7cyclictest0-21swapper/107:35:021
1697599111,2cyclictest21-21rcuc/108:50:141
1697599110,9cyclictest0-21swapper/107:15:151
1697599110,2cyclictest0-21swapper/108:45:261
1697499116,3cyclictest6518-21grep08:00:270
1697499112,6cyclictest0-21swapper/007:17:220
1697799107,2cyclictest0-21swapper/308:00:163
1697799104,4cyclictest31377-21telnet07:45:133
1697799100,7cyclictest0-21swapper/307:23:593
1697699107,2cyclictest0-21swapper/207:10:192
1697599105,3cyclictest21514-21grep07:20:121
1697599100,8cyclictest0-21swapper/109:00:251
1697599100,8cyclictest0-21swapper/107:30:141
1697499107,2cyclictest0-21swapper/008:25:250
1697499107,2cyclictest0-21swapper/008:15:160
1697499105,3cyclictest277-21jbd2/sda1-807:40:060
1697499102,6cyclictest0-21swapper/007:47:270
169779995,2cyclictest37-21rcuc/307:35:253
169779994,3cyclictest24361-21processes08:45:193
169769992,6cyclictest0-21swapper/208:27:582
169769990,5cyclictest0-21swapper/208:55:002
169759996,2cyclictest0-21swapper/107:25:121
169749991,6cyclictest32340-21cut09:05:180
169749991,6cyclictest0-21swapper/008:37:390
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional