You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 15:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot1s.osadl.org (updated Mon Dec 15, 2025 12:45:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1578799120120,0cyclictest37-21ksoftirqd/311:34:433
1579899101100,1cyclictest0-21swapper/510:58:565
1578199100100,0cyclictest29-21ksoftirqd/211:51:492
15787999896,1cyclictest37-21ksoftirqd/309:56:493
15787999796,0cyclictest37-21ksoftirqd/307:24:083
15787999393,0cyclictest37-21ksoftirqd/311:22:343
15798999190,1cyclictest0-21swapper/511:01:095
15809998983,1cyclictest0-21swapper/711:22:587
15798998988,1cyclictest0-21swapper/509:52:145
15804998279,2cyclictest0-21swapper/608:35:406
15804997269,2cyclictest0-21swapper/608:05:076
15804997269,2cyclictest0-21swapper/608:05:066
15794996361,1cyclictest0-21swapper/410:37:024
1542126242,17sleep50-21swapper/507:08:025
1540926242,17sleep40-21swapper/407:07:544
15809995554,1cyclictest0-21swapper/711:34:437
15776994949,0cyclictest21-21ksoftirqd/110:58:561
15770994948,1cyclictest3-21ksoftirqd/010:37:020
1541224827,18sleep70-21swapper/707:07:567
1535724736,8sleep60-21swapper/607:07:076
1532424715,18sleep20-21swapper/207:06:392
15776993939,0cyclictest21-21ksoftirqd/111:01:091
1550523918,18sleep00-21swapper/007:09:100
15794993838,0cyclictest192950irq/36-eth1-rx-08:49:394
15781993837,1cyclictest29-21ksoftirqd/210:53:572
1546423817,18sleep30-21swapper/307:08:403
1465623813,8sleep10-21swapper/107:05:171
15776993737,0cyclictest21-21ksoftirqd/109:52:141
15809993231,1cyclictest0-21swapper/709:56:497
15809993230,2cyclictest0-21swapper/707:24:097
1578799302,26cyclictest0-21swapper/309:04:473
15770992726,1cyclictest0-21swapper/008:49:390
15770992411,12cyclictest18303-21mrtg11:30:000
1578799232,18cyclictest0-21swapper/310:28:193
1578799223,18cyclictest0-21swapper/312:16:163
15804992120,1cyclictest0-21swapper/611:51:496
1578799212,18cyclictest0-21swapper/311:57:073
1578799212,18cyclictest0-21swapper/310:08:263
1578799210,18cyclictest0-21swapper/310:14:353
1578799202,17cyclictest0-21swapper/310:58:153
1578799200,19cyclictest0-21swapper/308:17:503
1578799200,17cyclictest0-21swapper/308:50:093
15787991918,1cyclictest0-21swapper/309:40:203
1578799191,17cyclictest0-21swapper/312:09:093
1578799190,18cyclictest0-21swapper/308:49:393
1578799190,17cyclictest0-21swapper/311:53:573
1579899180,2cyclictest0-21swapper/510:43:595
15794991817,1cyclictest0-21swapper/407:51:184
1578799180,17cyclictest0-21swapper/311:45:293
1578799180,17cyclictest0-21swapper/310:04:263
1577699180,17cyclictest0-21swapper/107:15:201
1577099181,1cyclictest3872-21runrttasks08:10:150
1577099181,1cyclictest3872-21runrttasks08:10:150
1577699172,14cyclictest26499-21awk07:30:001
1580999160,13cyclictest0-21swapper/708:15:007
1580999160,13cyclictest0-21swapper/708:14:597
1580999160,13cyclictest0-21swapper/707:58:597
1579899160,13cyclictest0-21swapper/512:31:595
15809991511,4cyclictest0-21swapper/709:32:147
1580999150,1cyclictest0-21swapper/708:01:137
1580499151,13cyclictest10268-21munin-run10:10:006
1579899150,13cyclictest0-21swapper/512:06:145
1578799150,13cyclictest31547-21basename07:40:003
1577099150,10cyclictest0-21swapper/012:30:010
1577099150,10cyclictest0-21swapper/012:30:010
1579499141,2cyclictest0-21swapper/409:55:594
1579499141,12cyclictest0-21swapper/410:24:594
15794991411,2cyclictest0-21swapper/408:15:444
15776991412,1cyclictest2487-21snmpd11:24:591
15776991412,1cyclictest2487-21snmpd08:33:591
15776991412,1cyclictest2487-21snmpd08:07:141
15776991412,1cyclictest2487-21snmpd08:07:141
15809991311,2cyclictest0-21swapper/708:24:597
1579899130,2cyclictest0-21swapper/511:41:435
15794991310,3cyclictest0-21swapper/409:43:294
1579499130,12cyclictest0-21swapper/412:35:224
15776991312,1cyclictest2487-21snmpd09:12:591
1579899120,2cyclictest0-21swapper/511:57:335
1579899120,2cyclictest0-21swapper/507:18:455
1579499120,11cyclictest0-21swapper/409:25:474
1577099127,2cyclictest0-21swapper/010:54:590
1577099127,2cyclictest0-21swapper/007:15:000
15770991212,0cyclictest2487-21snmpd09:35:290
15770991212,0cyclictest2487-21snmpd09:12:290
15770991212,0cyclictest2487-21snmpd08:04:280
15770991211,1cyclictest2487-21snmpd08:28:290
1577099120,9cyclictest0-21swapper/010:20:000
15809991110,1cyclictest0-21swapper/709:18:147
1580499118,2cyclictest0-21swapper/610:41:296
1579499118,2cyclictest0-21swapper/412:27:594
1579499118,2cyclictest0-21swapper/412:27:594
1579499110,10cyclictest0-21swapper/407:30:204
15781991111,0cyclictest2487-21snmpd08:59:592
15776991110,0cyclictest2487-21snmpd08:14:441
15776991110,0cyclictest2487-21snmpd08:14:441
1577099117,1cyclictest2626-21mrtg09:55:000
1577099116,2cyclictest0-21swapper/012:10:000
1577099116,2cyclictest0-21swapper/010:10:000
1577099111,8cyclictest0-21swapper/012:30:520
15770991110,1cyclictest2196-21redis-server07:30:150
1577099110,9cyclictest0-21swapper/007:25:000
1577099110,7cyclictest926450latency_hist08:00:000
1577099110,7cyclictest3090050latency_hist11:55:000
1577099110,7cyclictest3043250latency_hist10:50:000
1577099110,7cyclictest0-21swapper/010:41:350
1580999109,1cyclictest0-21swapper/708:52:437
1580499108,2cyclictest0-21swapper/611:13:146
1577699108,1cyclictest2487-21snmpd12:09:301
15776991010,0cyclictest2487-21snmpd12:19:291
1577699100,1cyclictest0-21swapper/111:38:221
1577099107,2cyclictest0-21swapper/008:55:000
1577099107,1cyclictest0-21swapper/012:35:140
1577099107,1cyclictest0-21swapper/008:30:130
1577099106,2cyclictest0-21swapper/011:09:520
1577099106,1cyclictest0-21swapper/009:45:030
1577099101,6cyclictest0-21swapper/011:45:150
1577099100,9cyclictest0-21swapper/008:57:430
1577099100,9cyclictest0-21swapper/008:05:230
1577099100,9cyclictest0-21swapper/008:05:220
1577099100,8cyclictest0-21swapper/012:20:210
1577099100,8cyclictest0-21swapper/012:20:200
1577099100,8cyclictest0-21swapper/011:39:550
1577099100,8cyclictest0-21swapper/009:30:270
1577099100,8cyclictest0-21swapper/008:40:010
1577099100,8cyclictest0-21swapper/007:36:020
1577099100,7cyclictest29955-21latency_hist09:44:590
1577099100,7cyclictest1986750latency_hist09:25:000
1577099100,7cyclictest0-21swapper/011:25:010
1577099100,7cyclictest0-21swapper/009:10:010
158099997,2cyclictest0-21swapper/708:38:297
158099996,3cyclictest0-21swapper/709:02:597
158099990,2cyclictest0-21swapper/710:06:267
158049998,1cyclictest0-21swapper/609:07:446
158049991,7cyclictest0-21swapper/610:10:226
157989996,3cyclictest0-21swapper/509:04:145
157989992,4cyclictest0-21swapper/508:20:155
157989991,3cyclictest0-21swapper/508:50:145
157989990,2cyclictest0-21swapper/512:22:365
157989990,2cyclictest0-21swapper/512:22:365
157949998,1cyclictest0-21swapper/411:18:294
157949996,2cyclictest0-21swapper/412:05:444
157949993,3cyclictest0-21swapper/411:52:594
157949993,3cyclictest0-21swapper/411:27:584
157949993,3cyclictest0-21swapper/409:04:304
157949990,2cyclictest0-21swapper/411:39:294
157949990,2cyclictest0-21swapper/408:52:294
157879997,1cyclictest2722-21portstat_8012:00:193
157879993,4cyclictest0-21swapper/307:49:173
157879992,3cyclictest0-21swapper/309:29:113
157879991,7cyclictest0-21swapper/311:15:133
157879991,7cyclictest0-21swapper/311:05:193
157879991,7cyclictest0-21swapper/310:25:003
157879991,7cyclictest0-21swapper/309:50:173
157879991,7cyclictest0-21swapper/308:30:193
157879991,7cyclictest0-21swapper/307:10:103
157769999,0cyclictest2536-21lldpd08:46:261
157769991,7cyclictest0-21swapper/109:40:121
157769991,7cyclictest0-21swapper/109:00:241
157769991,7cyclictest0-21swapper/108:55:011
157769991,7cyclictest0-21swapper/108:20:141
157769991,7cyclictest0-21swapper/108:15:201
157769991,7cyclictest0-21swapper/108:00:181
157769991,7cyclictest0-21swapper/107:30:161
157709997,1cyclictest0-21swapper/012:15:000
157709997,1cyclictest0-21swapper/011:55:160
157709996,2cyclictest0-21swapper/007:45:220
157709996,1cyclictest9769-21latency_hist09:05:010
157709996,1cyclictest0-21swapper/012:17:180
157709994,3cyclictest0-21swapper/010:01:040
157709991,7cyclictest0-21swapper/009:15:130
157709990,8cyclictest1591-21mrtg07:45:000
157709990,8cyclictest0-21swapper/011:40:270
157709990,8cyclictest0-21swapper/011:15:000
157709990,8cyclictest0-21swapper/010:20:460
157709990,8cyclictest0-21swapper/008:20:180
157709990,8cyclictest0-21swapper/007:25:580
157709990,7cyclictest22387-21mrtg09:30:000
157709990,7cyclictest0-21swapper/012:00:180
157709990,7cyclictest0-21swapper/011:17:290
157709990,7cyclictest0-21swapper/010:15:010
157709990,7cyclictest0-21swapper/009:59:190
157709990,7cyclictest0-21swapper/008:45:010
157709990,7cyclictest0-21swapper/008:20:010
157709990,7cyclictest0-21swapper/007:50:210
157709990,1cyclictest0-21swapper/011:03:340
157709990,1cyclictest0-21swapper/010:55:130
28371280,6sleep228395-21munin-run11:50:002
158099987,1cyclictest0-21swapper/711:54:447
158099987,1cyclictest0-21swapper/711:02:297
158099987,1cyclictest0-21swapper/710:11:457
158099987,1cyclictest0-21swapper/707:16:587
158099983,4cyclictest0-21swapper/710:43:147
158099983,4cyclictest0-21swapper/710:15:167
158099983,4cyclictest0-21swapper/707:25:177
158099982,4cyclictest0-21swapper/707:10:117
158099981,6cyclictest0-21swapper/709:35:177
158099980,7cyclictest0-21swapper/709:05:147
158049986,2cyclictest0-21swapper/608:59:146
158049983,3cyclictest0-21swapper/611:35:166
158049980,1cyclictest0-21swapper/610:45:146
157989983,4cyclictest0-21swapper/509:43:145
157989983,4cyclictest0-21swapper/509:15:595
157989981,6cyclictest12650irq/19-ata_piix07:49:125
157989981,6cyclictest0-21swapper/511:50:175
157989980,4cyclictest0-21swapper/509:05:445
157989980,2cyclictest0-21swapper/508:09:295
157989980,2cyclictest0-21swapper/508:09:295
157989980,1cyclictest0-21swapper/508:48:005
157989980,1cyclictest0-21swapper/507:54:135
157949984,3cyclictest0-21swapper/411:02:144
157949983,4cyclictest0-21swapper/412:10:444
157949983,4cyclictest0-21swapper/411:44:584
157949983,4cyclictest0-21swapper/410:27:294
157949983,4cyclictest0-21swapper/407:37:144
157949982,4cyclictest0-21swapper/410:40:444
157949982,3cyclictest0-21swapper/408:02:584
157949981,6cyclictest0-21swapper/409:15:014
157949981,6cyclictest0-21swapper/408:06:144
157949981,6cyclictest0-21swapper/408:06:134
157949981,2cyclictest0-21swapper/410:51:444
157949980,8cyclictest0-21swapper/408:40:154
157949980,7cyclictest0-21swapper/407:13:484
157949980,5cyclictest0-21swapper/407:29:294
157879985,1cyclictest28616-21portstat_8008:35:193
157879983,4cyclictest0-21swapper/312:14:053
157879983,4cyclictest0-21swapper/309:12:123
157879982,3cyclictest0-21swapper/310:45:593
157879982,3cyclictest0-21swapper/309:15:013
157879981,6cyclictest0-21swapper/312:25:143
157879981,6cyclictest0-21swapper/312:25:133
157879981,6cyclictest0-21swapper/311:40:003
157879981,6cyclictest0-21swapper/311:25:163
157879981,6cyclictest0-21swapper/309:20:183
157879981,6cyclictest0-21swapper/309:05:143
157879981,6cyclictest0-21swapper/308:55:143
157879981,6cyclictest0-21swapper/308:25:203
157879981,6cyclictest0-21swapper/308:20:233
157879981,6cyclictest0-21swapper/308:00:193
157879981,6cyclictest0-21swapper/307:55:183
157879981,6cyclictest0-21swapper/307:50:193
157879981,6cyclictest0-21swapper/307:35:003
157879981,6cyclictest0-21swapper/307:25:243
157879981,3cyclictest0-21swapper/307:43:233
157819983,4cyclictest0-21swapper/212:05:162
157819981,6cyclictest0-21swapper/212:25:222
157819981,6cyclictest0-21swapper/212:25:222
157819981,6cyclictest0-21swapper/212:10:142
157819981,6cyclictest0-21swapper/209:15:182
157769983,4cyclictest0-21swapper/111:40:151
157769981,6cyclictest0-21swapper/111:50:141
157769981,6cyclictest0-21swapper/110:40:131
157769981,6cyclictest0-21swapper/110:30:141
157769981,6cyclictest0-21swapper/110:20:161
157769981,6cyclictest0-21swapper/109:55:171
157769981,6cyclictest0-21swapper/109:25:171
157769981,6cyclictest0-21swapper/109:20:201
157769981,6cyclictest0-21swapper/108:40:131
157769981,6cyclictest0-21swapper/108:25:191
157769981,6cyclictest0-21swapper/107:55:191
157769980,7cyclictest0-21swapper/112:20:141
157769980,7cyclictest0-21swapper/112:20:141
157709986,1cyclictest0-21swapper/010:25:180
157709986,1cyclictest0-21swapper/007:15:230
157709980,7cyclictest0-21swapper/011:30:140
157709980,6cyclictest23061-21cat10:35:000
30363270,1sleep50-21swapper/510:49:185
158099973,4cyclictest0-21swapper/708:59:447
158099973,3cyclictest0-21swapper/708:06:587
158099973,3cyclictest0-21swapper/708:06:587
158099972,4cyclictest0-21swapper/710:50:597
158099971,5cyclictest0-21swapper/712:20:137
158099971,5cyclictest0-21swapper/712:20:137
158099971,5cyclictest0-21swapper/711:15:147
158099971,5cyclictest0-21swapper/709:29:447
158099971,5cyclictest0-21swapper/707:52:297
158099970,6cyclictest0-21swapper/712:05:197
158099970,6cyclictest0-21swapper/710:21:567
158099970,6cyclictest0-21swapper/709:10:137
158099970,6cyclictest0-21swapper/708:25:157
158099970,6cyclictest0-21swapper/707:42:517
158099970,4cyclictest0-21swapper/710:57:297
158099970,4cyclictest0-21swapper/707:46:147
158099970,1cyclictest0-21swapper/712:01:297
158049972,4cyclictest0-21swapper/612:30:166
158049972,4cyclictest0-21swapper/609:10:156
158049972,2cyclictest0-21swapper/607:15:166
158049970,6cyclictest0-21swapper/612:25:156
158049970,6cyclictest0-21swapper/612:25:156
158049970,5cyclictest0-21swapper/609:59:146
157989975,2cyclictest0-21swapper/512:35:175
157989975,1cyclictest8374-21chrt12:10:535
157989975,1cyclictest14586-21switchtime10:15:215
157989975,1cyclictest12393-21portstat_898011:15:205
157989973,3cyclictest0-21swapper/511:28:595
157989973,3cyclictest0-21swapper/510:32:145
157989973,3cyclictest0-21swapper/510:25:165
157989972,4cyclictest0-21swapper/507:36:445
157989971,2cyclictest0-21swapper/509:30:135
157989970,6cyclictest18005-21sh08:15:145
157989970,6cyclictest0-21swapper/511:35:215
157989970,6cyclictest0-21swapper/511:32:445
157989970,6cyclictest0-21swapper/511:10:135
157989970,6cyclictest0-21swapper/510:50:305
157989970,6cyclictest0-21swapper/507:10:275
157989970,4cyclictest0-21swapper/508:00:175
157989970,4cyclictest0-21swapper/507:25:165
157989970,2cyclictest0-21swapper/512:15:595
157989970,1cyclictest0-21swapper/508:12:445
157989970,1cyclictest0-21swapper/508:12:445
157949975,1cyclictest25260-21latency_hist09:35:004
157949975,1cyclictest22295-21sh07:20:124
157949975,1cyclictest13016-21switchtime12:20:214
157949975,1cyclictest13016-21switchtime12:20:204
157949974,2cyclictest0-21swapper/412:32:454
157949972,4cyclictest0-21swapper/410:47:294
157949972,4cyclictest0-21swapper/410:13:594
157949972,4cyclictest0-21swapper/409:45:134
157949972,4cyclictest0-21swapper/409:23:294
157949972,2cyclictest0-21swapper/408:55:284
157949971,5cyclictest0-21swapper/412:18:144
157949971,5cyclictest0-21swapper/409:35:144
157949971,5cyclictest0-21swapper/407:55:594
157949971,4cyclictest0-21swapper/410:55:284
157949971,4cyclictest0-21swapper/408:39:594
157949970,5cyclictest0-21swapper/411:32:294
157949970,4cyclictest0-21swapper/407:48:434
157879973,4cyclictest0-21swapper/311:42:483
157879973,3cyclictest0-21swapper/312:20:343
157879973,3cyclictest0-21swapper/312:20:343
157879973,3cyclictest0-21swapper/311:01:153
157879973,3cyclictest0-21swapper/310:51:503
157879973,3cyclictest0-21swapper/310:30:233
157879973,3cyclictest0-21swapper/309:45:183
157879973,3cyclictest0-21swapper/308:42:353
157879973,3cyclictest0-21swapper/308:05:183
157879973,3cyclictest0-21swapper/308:05:183
157879972,4cyclictest0-21swapper/312:35:113
157879972,3cyclictest0-21swapper/310:15:203
157879971,5cyclictest0-21swapper/312:30:243
157879971,5cyclictest0-21swapper/311:10:163
157879971,5cyclictest0-21swapper/310:40:153
157879971,5cyclictest0-21swapper/310:35:153
157879971,5cyclictest0-21swapper/309:35:153
157879971,5cyclictest0-21swapper/309:34:083
157879971,5cyclictest0-21swapper/308:10:143
157879971,5cyclictest0-21swapper/308:10:133
157879971,5cyclictest0-21swapper/307:15:003
157819975,1cyclictest6036-21munin-node11:05:142
157819975,1cyclictest4776-21unixbench_singl09:55:222
157819975,1cyclictest25514-21cstates09:35:132
157819973,3cyclictest0-21swapper/210:40:172
157819973,3cyclictest0-21swapper/210:10:162
157819973,3cyclictest0-21swapper/207:40:172
157819972,4cyclictest0-21swapper/208:45:172
157819971,5cyclictest0-21swapper/212:30:142
157819971,5cyclictest0-21swapper/211:55:152
157819971,5cyclictest0-21swapper/211:30:142
157819971,5cyclictest0-21swapper/210:55:162
157819971,5cyclictest0-21swapper/209:34:592
157819971,5cyclictest0-21swapper/209:20:142
157819971,5cyclictest0-21swapper/208:24:322
157819971,5cyclictest0-21swapper/208:00:212
157819971,5cyclictest0-21swapper/207:55:222
157819971,5cyclictest0-21swapper/207:20:132
157819970,6cyclictest20259-21cpu09:25:112
157819970,6cyclictest19503-21cstates12:35:132
157819970,6cyclictest16703-21tune2fs07:10:102
157819970,6cyclictest14103-21latency10:15:162
157819970,6cyclictest0-21swapper/211:03:462
157819970,6cyclictest0-21swapper/210:30:152
157819970,6cyclictest0-21swapper/210:23:072
157819970,6cyclictest0-21swapper/210:05:182
157819970,6cyclictest0-21swapper/209:49:082
157819970,6cyclictest0-21swapper/209:10:162
157819970,6cyclictest0-21swapper/207:45:312
157819970,6cyclictest0-21swapper/207:15:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional