You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 01:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot1s.osadl.org (updated Mon Dec 15, 2025 00:45:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13019999291,1cyclictest0-21swapper/523:50:305
13029999190,1cyclictest0-21swapper/722:42:397
13019997776,1cyclictest0-21swapper/522:32:495
1273126141,17sleep50-21swapper/519:09:055
13008995656,0cyclictest37-21ksoftirqd/300:04:113
1263425635,17sleep40-21swapper/419:07:454
13029995452,1cyclictest0-21swapper/722:53:087
13029995452,1cyclictest0-21swapper/722:53:087
1272225029,18sleep70-21swapper/719:09:007
1249224828,17sleep60-21swapper/619:05:466
1273824613,18sleep30-21swapper/319:09:123
1258423918,17sleep10-21swapper/119:07:011
1255623716,18sleep20-21swapper/219:06:382
13008993636,0cyclictest37-21ksoftirqd/321:31:253
1269523615,18sleep00-21swapper/019:08:370
12987993331,1cyclictest3-21ksoftirqd/023:55:240
13019992726,1cyclictest0-21swapper/520:03:135
1300899210,2cyclictest0-21swapper/322:55:073
1301399181,16cyclictest28764-21munin-run19:40:014
1302599142,11cyclictest0-21swapper/619:56:116
13025991410,3cyclictest0-21swapper/623:05:576
13029991311,2cyclictest0-21swapper/720:30:157
13029991310,2cyclictest0-21swapper/720:11:117
1302599130,12cyclictest0-21swapper/600:28:126
1301999130,1cyclictest0-21swapper/500:00:165
1298799131,9cyclictest0-21swapper/023:10:010
1302599129,2cyclictest0-21swapper/622:12:276
1302599120,1cyclictest0-21swapper/620:04:556
1298799121,10cyclictest0-21swapper/000:05:000
1298799120,6cyclictest0-21swapper/023:35:350
1302999118,2cyclictest27432sleep723:03:127
1301999110,10cyclictest0-21swapper/519:51:475
1301399118,3cyclictest0-21swapper/423:53:424
1301399118,3cyclictest0-21swapper/422:55:424
12991991111,0cyclictest2487-21snmpd19:42:121
1298799118,1cyclictest26230-21latency_hist19:35:000
1298799118,1cyclictest0-21swapper/000:20:150
1298799117,2cyclictest0-21swapper/019:45:220
1298799111,9cyclictest0-21swapper/019:25:000
1298799111,7cyclictest0-21swapper/019:40:000
1298799110,9cyclictest0-21swapper/022:05:000
1298799110,8cyclictest29224-21latency_hist20:45:010
1298799110,8cyclictest0-21swapper/023:55:010
1298799110,8cyclictest0-21swapper/022:50:010
1298799110,8cyclictest0-21swapper/022:50:010
1298799110,8cyclictest0-21swapper/019:30:010
1298799110,8cyclictest0-21swapper/019:15:000
1298799110,7cyclictest1540050cat22:25:000
1298799110,7cyclictest1465650cat21:20:000
1298799110,7cyclictest0-21swapper/020:55:000
1298799110,7cyclictest0-21swapper/020:14:590
1302999107,2cyclictest0-21swapper/700:00:127
1302599107,2cyclictest0-21swapper/620:47:416
1302599102,4cyclictest0-21swapper/621:57:116
1302599101,2cyclictest0-21swapper/619:28:426
1301999100,9cyclictest0-21swapper/519:43:485
1301999100,9cyclictest0-21swapper/500:05:475
1300899101,8cyclictest0-21swapper/322:05:353
13008991010,0cyclictest2487-21snmpd19:20:113
1300099101,8cyclictest0-21swapper/220:45:142
1299199100,9cyclictest0-21swapper/100:30:141
1298799107,2cyclictest0-21swapper/020:20:190
1298799107,1cyclictest0-21swapper/022:10:230
1298799106,2cyclictest0-21swapper/022:40:570
1298799100,9cyclictest0-21swapper/023:35:000
1298799100,9cyclictest0-21swapper/019:15:180
1298799100,8cyclictest0-21swapper/023:18:380
1298799100,8cyclictest0-21swapper/023:15:000
1298799100,8cyclictest0-21swapper/022:34:390
1298799100,8cyclictest0-21swapper/021:45:250
1298799100,8cyclictest0-21swapper/021:25:170
1298799100,8cyclictest0-21swapper/021:10:220
1298799100,8cyclictest0-21swapper/020:00:130
1298799100,7cyclictest24663-21latency_hist21:40:000
1298799100,7cyclictest22146-21latency_hist21:35:000
1298799100,7cyclictest16023-21latency_hist00:34:590
1298799100,7cyclictest0-21swapper/020:05:190
1298799100,7cyclictest0-21swapper/000:40:000
130299993,3cyclictest0-21swapper/723:55:127
130299993,3cyclictest0-21swapper/700:06:567
130299990,2cyclictest0-21swapper/723:36:427
130299990,1cyclictest0-21swapper/721:25:007
130259997,2cyclictest0-21swapper/620:27:416
130259993,4cyclictest0-21swapper/620:31:576
130259993,3cyclictest0-21swapper/600:34:576
130259991,5cyclictest0-21swapper/622:33:426
130259991,5cyclictest0-21swapper/620:38:426
130259991,2cyclictest0-21swapper/623:35:126
130259991,2cyclictest0-21swapper/621:30:426
130259990,8cyclictest0-21swapper/623:25:196
130259990,2cyclictest0-21swapper/621:24:576
130259990,2cyclictest0-21swapper/619:45:426
130199994,4cyclictest0-21swapper/520:28:125
130199993,4cyclictest0-21swapper/520:40:115
130199993,3cyclictest0-21swapper/522:59:265
130199993,3cyclictest0-21swapper/522:05:565
130199993,3cyclictest0-21swapper/521:58:275
130199993,3cyclictest0-21swapper/520:30:125
130199992,4cyclictest0-21swapper/520:35:575
130199990,8cyclictest0-21swapper/523:33:485
130199990,8cyclictest0-21swapper/522:27:485
130199990,2cyclictest0-21swapper/522:53:425
130199990,2cyclictest0-21swapper/522:53:425
130199990,2cyclictest0-21swapper/522:12:295
130139991,7cyclictest0-21swapper/422:35:204
130089991,7cyclictest0-21swapper/323:50:153
130089991,7cyclictest0-21swapper/323:40:133
130089991,7cyclictest0-21swapper/323:30:143
130089991,7cyclictest0-21swapper/323:15:003
130089991,7cyclictest0-21swapper/322:25:003
130089991,7cyclictest0-21swapper/322:10:193
130089991,7cyclictest0-21swapper/321:50:223
130089991,7cyclictest0-21swapper/321:35:433
130089991,7cyclictest0-21swapper/321:25:233
130089991,7cyclictest0-21swapper/320:35:003
130089991,2cyclictest0-21swapper/322:15:213
130089990,1cyclictest0-21swapper/319:11:513
130009991,7cyclictest0-21swapper/223:50:012
130009991,7cyclictest0-21swapper/221:20:162
130009991,7cyclictest0-21swapper/220:15:142
130009991,7cyclictest0-21swapper/219:15:012
130009991,7cyclictest0-21swapper/200:00:012
130009990,8cyclictest0-21swapper/222:20:172
129919991,7cyclictest0-21swapper/123:45:211
129919991,7cyclictest0-21swapper/123:25:161
129919991,7cyclictest0-21swapper/123:20:211
129919991,7cyclictest0-21swapper/122:50:191
129919991,7cyclictest0-21swapper/122:50:191
129919991,7cyclictest0-21swapper/122:10:001
129919991,7cyclictest0-21swapper/120:40:231
129919991,7cyclictest0-21swapper/120:19:591
129919991,7cyclictest0-21swapper/119:50:141
129919991,7cyclictest0-21swapper/119:30:131
129919991,7cyclictest0-21swapper/100:15:151
129919991,7cyclictest0-21swapper/100:00:191
129919990,1cyclictest0-21swapper/123:13:481
129879996,1cyclictest0-21swapper/021:10:000
129879996,1cyclictest0-21swapper/019:50:130
129879994,3cyclictest0-21swapper/020:17:030
129879991,7cyclictest2427-21cat22:00:000
129879991,6cyclictest0-21swapper/020:35:250
129879990,8cyclictest0-21swapper/022:25:200
129879990,8cyclictest0-21swapper/021:50:240
129879990,8cyclictest0-21swapper/021:40:190
129879990,7cyclictest31725-21cat20:49:550
129879990,7cyclictest31256-21cat19:44:560
129879990,7cyclictest0-21swapper/023:25:010
129879990,7cyclictest0-21swapper/022:55:000
129879990,7cyclictest0-21swapper/022:55:000
129879990,7cyclictest0-21swapper/022:20:000
129879990,7cyclictest0-21swapper/020:34:590
129879990,7cyclictest0-21swapper/000:05:200
129879990,6cyclictest8450-21mrtg00:20:000
129879990,6cyclictest7700-21rateup22:10:000
129879990,6cyclictest21670-21munin-run20:29:590
129879990,3cyclictest0-21swapper/022:39:390
129879990,1cyclictest0-21swapper/023:25:220
932280,1sleep70-21swapper/720:50:217
130299987,1cyclictest0-21swapper/720:45:127
130299986,1cyclictest15547-21munin-run23:30:007
130299983,4cyclictest0-21swapper/721:25:127
130299983,4cyclictest0-21swapper/719:58:277
130299982,1cyclictest0-21swapper/719:45:157
130299981,6cyclictest0-21swapper/721:00:007
130299980,7cyclictest0-21swapper/719:23:477
130299980,2cyclictest0-21swapper/722:22:567
130299980,2cyclictest0-21swapper/722:10:267
130299980,2cyclictest0-21swapper/720:36:417
130259983,4cyclictest0-21swapper/623:50:566
130259983,4cyclictest0-21swapper/623:45:426
130259983,4cyclictest0-21swapper/623:15:416
130259983,4cyclictest0-21swapper/622:42:116
130259983,4cyclictest0-21swapper/622:17:276
130259983,4cyclictest0-21swapper/620:55:126
130259983,4cyclictest0-21swapper/620:23:266
130259982,3cyclictest0-21swapper/623:40:276
130259982,3cyclictest0-21swapper/620:17:276
130259982,3cyclictest0-21swapper/619:32:116
130259982,3cyclictest0-21swapper/619:13:416
130259981,6cyclictest0-21swapper/619:20:016
130259981,5cyclictest0-21swapper/620:52:566
130259981,4cyclictest0-21swapper/622:06:416
130259981,4cyclictest0-21swapper/619:22:276
130259981,2cyclictest0-21swapper/622:27:116
130259981,2cyclictest0-21swapper/621:00:126
130259980,5cyclictest0-21swapper/621:13:276
130199983,4cyclictest0-21swapper/523:44:275
130199983,4cyclictest0-21swapper/522:43:115
130199983,4cyclictest0-21swapper/521:11:115
130199983,4cyclictest0-21swapper/500:16:275
130199983,2cyclictest0-21swapper/523:03:565
130199983,2cyclictest0-21swapper/521:41:275
130199983,2cyclictest0-21swapper/521:09:265
130199983,2cyclictest0-21swapper/520:06:415
130199982,4cyclictest0-21swapper/521:45:125
130199982,4cyclictest0-21swapper/521:35:575
130199982,4cyclictest0-21swapper/521:28:425
130199982,3cyclictest0-21swapper/521:16:275
130199982,3cyclictest0-21swapper/519:12:125
130199982,3cyclictest0-21swapper/500:25:125
130199982,3cyclictest0-21swapper/500:21:285
130199981,4cyclictest0-21swapper/523:39:115
130199981,1cyclictest0-21swapper/519:35:005
130199980,7cyclictest0-21swapper/500:30:145
130199980,5cyclictest0-21swapper/520:15:275
130199980,2cyclictest0-21swapper/522:01:425
130199980,1cyclictest0-21swapper/519:26:275
130139987,1cyclictest0-21swapper/400:27:414
130139984,3cyclictest0-21swapper/423:25:264
130139981,6cyclictest0-21swapper/421:40:134
130139981,6cyclictest0-21swapper/420:30:174
130139981,1cyclictest0-21swapper/420:09:594
130139980,2cyclictest0-21swapper/422:20:274
130139980,2cyclictest0-21swapper/400:24:414
130089983,4cyclictest0-21swapper/319:55:213
130089981,6cyclictest0-21swapper/323:55:163
130089981,6cyclictest0-21swapper/323:45:173
130089981,6cyclictest0-21swapper/323:25:223
130089981,6cyclictest0-21swapper/323:05:163
130089981,6cyclictest0-21swapper/322:35:153
130089981,6cyclictest0-21swapper/321:40:003
130089981,6cyclictest0-21swapper/321:10:133
130089981,6cyclictest0-21swapper/321:00:133
130089981,6cyclictest0-21swapper/320:55:143
130089981,6cyclictest0-21swapper/320:35:223
130089981,6cyclictest0-21swapper/320:15:183
130089981,6cyclictest0-21swapper/319:50:143
130089981,6cyclictest0-21swapper/319:25:183
130089981,6cyclictest0-21swapper/300:39:593
130089981,6cyclictest0-21swapper/300:25:133
130089981,6cyclictest0-21swapper/300:20:243
130089981,6cyclictest0-21swapper/300:15:183
130089981,6cyclictest0-21swapper/300:10:173
130089980,7cyclictest0-21swapper/322:00:143
130009981,6cyclictest0-21swapper/223:25:152
130009981,6cyclictest0-21swapper/223:20:192
130009981,6cyclictest0-21swapper/223:15:172
130009981,6cyclictest0-21swapper/222:50:152
130009981,6cyclictest0-21swapper/222:50:152
130009981,6cyclictest0-21swapper/222:45:132
130009981,6cyclictest0-21swapper/222:45:132
130009981,6cyclictest0-21swapper/221:45:002
130009981,6cyclictest0-21swapper/221:35:392
130009981,6cyclictest0-21swapper/221:15:222
130009981,6cyclictest0-21swapper/220:55:172
130009981,6cyclictest0-21swapper/220:25:232
130009981,6cyclictest0-21swapper/220:10:162
130009981,6cyclictest0-21swapper/219:20:232
130009981,6cyclictest0-21swapper/200:35:212
130009981,6cyclictest0-21swapper/200:30:202
130009981,6cyclictest0-21swapper/200:05:212
129919981,6cyclictest0-21swapper/123:55:141
129919981,6cyclictest0-21swapper/123:50:151
129919981,6cyclictest0-21swapper/123:30:131
129919981,6cyclictest0-21swapper/123:15:191
129919981,6cyclictest0-21swapper/123:05:121
129919981,6cyclictest0-21swapper/122:45:141
129919981,6cyclictest0-21swapper/122:45:141
129919981,6cyclictest0-21swapper/122:40:171
129919981,6cyclictest0-21swapper/122:25:181
129919981,6cyclictest0-21swapper/122:20:201
129919981,6cyclictest0-21swapper/121:55:191
129919981,6cyclictest0-21swapper/121:50:151
129919981,6cyclictest0-21swapper/121:25:191
129919981,6cyclictest0-21swapper/121:15:161
129919981,6cyclictest0-21swapper/121:00:191
129919981,6cyclictest0-21swapper/120:45:191
129919981,6cyclictest0-21swapper/120:35:251
129919981,6cyclictest0-21swapper/120:30:171
129919981,6cyclictest0-21swapper/120:20:161
129919981,6cyclictest0-21swapper/120:05:141
129919981,6cyclictest0-21swapper/119:55:181
129919981,6cyclictest0-21swapper/119:45:191
129919981,6cyclictest0-21swapper/119:25:161
129919981,6cyclictest0-21swapper/119:15:181
129919981,6cyclictest0-21swapper/100:35:221
129919981,6cyclictest0-21swapper/100:20:241
129919981,6cyclictest0-21swapper/100:05:161
129919980,7cyclictest0-21swapper/122:31:571
129879985,1cyclictest0-21swapper/023:45:440
129879985,1cyclictest0-21swapper/021:20:210
129879981,6cyclictest0-21swapper/021:00:160
129879981,6cyclictest0-21swapper/020:55:200
129879981,4cyclictest0-21swapper/019:55:190
129879980,7cyclictest0-21swapper/023:41:040
129879980,6cyclictest0-21swapper/023:00:150
129879980,6cyclictest0-21swapper/022:55:350
129879980,6cyclictest0-21swapper/000:25:160
129879980,6cyclictest0-21swapper/000:10:430
5684270,1sleep70-21swapper/700:12:077
18458270,1sleep50-21swapper/500:39:035
130299973,3cyclictest0-21swapper/722:09:117
130299973,3cyclictest0-21swapper/721:09:427
130299973,2cyclictest0-21swapper/722:02:577
130299972,4cyclictest0-21swapper/723:50:277
130299972,4cyclictest0-21swapper/721:49:567
130299972,4cyclictest0-21swapper/721:34:567
130299972,4cyclictest0-21swapper/721:04:577
130299972,4cyclictest0-21swapper/720:20:577
130299972,4cyclictest0-21swapper/719:35:177
130299972,4cyclictest0-21swapper/700:35:577
130299972,2cyclictest0-21swapper/721:42:417
130299971,4cyclictest0-21swapper/723:18:567
130299971,3cyclictest0-21swapper/719:11:277
130299970,6cyclictest0-21swapper/722:15:187
130299970,2cyclictest0-21swapper/723:24:577
130259975,1cyclictest22609-21grep21:35:376
130259974,2cyclictest0-21swapper/622:38:126
130259974,2cyclictest0-21swapper/621:46:576
130259972,4cyclictest0-21swapper/623:56:416
130259972,4cyclictest0-21swapper/623:20:426
130259972,4cyclictest0-21swapper/623:00:186
130259972,4cyclictest0-21swapper/622:55:126
130259972,4cyclictest0-21swapper/622:48:266
130259972,4cyclictest0-21swapper/622:48:266
130259972,4cyclictest0-21swapper/621:54:566
130259972,4cyclictest0-21swapper/621:40:576
130259972,4cyclictest0-21swapper/621:29:576
130259972,4cyclictest0-21swapper/621:18:276
130259972,4cyclictest0-21swapper/620:11:576
130259972,4cyclictest0-21swapper/619:41:266
130259972,4cyclictest0-21swapper/600:21:126
130259972,4cyclictest0-21swapper/600:01:126
130259971,5cyclictest0-21swapper/600:38:576
130259971,5cyclictest0-21swapper/600:10:426
130259971,5cyclictest0-21swapper/600:10:006
130259971,3cyclictest0-21swapper/621:08:576
130259970,7cyclictest0-21swapper/619:53:476
130259970,6cyclictest7739-21sed00:15:226
130259970,6cyclictest0-21swapper/620:07:376
130199975,1cyclictest16616-21sed21:20:235
130199975,1cyclictest12168-21ps23:20:205
130199973,3cyclictest0-21swapper/523:45:185
130199972,4cyclictest0-21swapper/523:58:425
130199972,4cyclictest0-21swapper/522:45:115
130199972,4cyclictest0-21swapper/522:45:115
130199972,4cyclictest0-21swapper/521:00:155
130199972,4cyclictest0-21swapper/520:20:175
130199972,2cyclictest0-21swapper/521:52:415
130199971,3cyclictest0-21swapper/523:10:425
130199971,3cyclictest0-21swapper/522:19:425
130199970,6cyclictest27928-21processes19:35:215
130199970,6cyclictest14660-21pmu-power23:25:225
130199970,4cyclictest0-21swapper/522:21:275
130199970,4cyclictest0-21swapper/519:19:565
130139973,4cyclictest0-21swapper/419:57:424
130139973,3cyclictest0-21swapper/419:10:424
130139972,4cyclictest0-21swapper/423:20:164
130139972,4cyclictest0-21swapper/419:25:164
130139972,3cyclictest0-21swapper/421:05:164
130139972,2cyclictest0-21swapper/420:45:154
130139971,5cyclictest0-21swapper/423:35:004
130139971,4cyclictest0-21swapper/419:50:174
130139970,6cyclictest16681-21latency_hist20:20:004
130139970,6cyclictest10234-21latency_hist22:15:004
130139970,6cyclictest0-21swapper/423:35:184
130139970,6cyclictest0-21swapper/420:25:234
130139970,4cyclictest0-21swapper/420:53:274
130139970,1cyclictest0-21swapper/423:15:264
130089975,1cyclictest11706-21if_err_ppp023:20:153
130089971,5cyclictest0-21swapper/323:15:153
130089971,5cyclictest0-21swapper/323:00:223
130089971,5cyclictest0-21swapper/322:50:153
130089971,5cyclictest0-21swapper/322:50:153
130089971,5cyclictest0-21swapper/322:45:153
130089971,5cyclictest0-21swapper/322:45:153
130089971,5cyclictest0-21swapper/322:40:163
130089971,5cyclictest0-21swapper/321:45:193
130089971,5cyclictest0-21swapper/321:20:133
130089971,5cyclictest0-21swapper/321:15:153
130089971,5cyclictest0-21swapper/320:50:153
130089971,5cyclictest0-21swapper/320:20:213
130089971,5cyclictest0-21swapper/320:10:153
130089971,5cyclictest0-21swapper/320:00:143
130089971,5cyclictest0-21swapper/319:40:143
130089971,5cyclictest0-21swapper/319:35:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional