You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 23:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot5s.osadl.org (updated Tue Dec 02, 2025 00:45:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4833342394370,14sleep40-21swapper/419:08:5510
4832012369345,15sleep20-21swapper/219:07:008
4833162365331,26sleep30-21swapper/319:08:389
4832062350327,14sleep70-21swapper/719:07:0613
4833212349306,14sleep80-21swapper/819:08:4314
4833612344304,30sleep110-21swapper/1119:09:183
4832392344321,14sleep10-21swapper/119:07:311
4832892343319,14sleep130-21swapper/1319:08:155
4832802342317,15sleep60-21swapper/619:08:0812
4833272340316,15sleep140-21swapper/1419:08:496
4832922339315,15sleep150-21swapper/1519:08:177
4832692339316,14sleep120-21swapper/1219:07:584
4831742338315,14sleep100-21swapper/1019:06:362
4832792337312,15sleep50-21swapper/519:08:0711
4831432334311,14sleep00-21swapper/019:06:100
4831562332309,14sleep90-21swapper/919:06:1915
483720996110,11cyclictest0-21swapper/619:50:2512
48372099480,23cyclictest0-21swapper/623:52:0312
483720994711,11cyclictest0-21swapper/622:13:1212
483720994711,11cyclictest0-21swapper/622:13:1212
483720994711,11cyclictest0-21swapper/621:29:1712
483720994711,11cyclictest0-21swapper/621:18:1712
483720994711,11cyclictest0-21swapper/620:23:2212
483720994711,11cyclictest0-21swapper/619:39:2612
483720994711,11cyclictest0-21swapper/600:35:5912
48372099440,43cyclictest0-21swapper/600:15:5912
48372099413,25cyclictest0-21swapper/623:19:0612
48372099413,25cyclictest0-21swapper/622:35:1112
483725994040,0cyclictest0-21swapper/822:23:1914
48372299400,30cyclictest0-21swapper/723:24:2513
483720994016,13cyclictest0-21swapper/622:02:1412
483720994016,13cyclictest0-21swapper/622:02:1312
483720993939,0cyclictest0-21swapper/622:32:4812
483710993939,0cyclictest0-21swapper/320:27:019
483700993936,2cyclictest8145-21CPU0
483745993837,1cyclictest0-21swapper/1422:23:196
48373099380,37cyclictest0-21swapper/922:49:4415
483720993836,1cyclictest1393-21snmpd19:23:0812
48372099360,11cyclictest0-21swapper/620:45:2012
48372099360,11cyclictest0-21swapper/619:17:2812
483742993535,0cyclictest0-21swapper/1322:23:195
483739993434,0cyclictest0-21swapper/1219:39:504
48372299347,21cyclictest0-21swapper/720:50:5913
483710993434,0cyclictest0-21swapper/321:45:409
483700993426,5cyclictest8138-21CPU0
483700993426,5cyclictest8138-21CPU0
483700993330,2cyclictest8148-21CPU0
483745993229,2cyclictest8141-21CPU6
483735993231,1cyclictest0-21swapper/1122:32:473
483725993230,1cyclictest8137-21CPU14
483703993231,0cyclictest0-21swapper/122:32:471
483700993129,1cyclictest8147-21CPU0
483700993113,17cyclictest8144-21CPU0
48374299300,29cyclictest0-21swapper/1323:45:305
483739993030,0cyclictest0-21swapper/1220:37:554
483735993029,1cyclictest0-21swapper/1123:03:213
483706993029,1cyclictest0-21swapper/222:32:478
48370699300,0cyclictest0-21swapper/222:08:018
48370699300,0cyclictest0-21swapper/222:08:018
48370099300,29cyclictest0-21swapper/023:54:110
48374299290,28cyclictest0-21swapper/1320:18:375
483735992927,2cyclictest1393-21snmpd21:20:143
483730992929,0cyclictest0-21swapper/922:55:4215
48372599290,0cyclictest0-21swapper/823:30:4814
483722992929,0cyclictest0-21swapper/721:53:0013
483722992927,1cyclictest1393-21snmpd22:00:0713
483722992927,1cyclictest1393-21snmpd22:00:0713
483715992929,0cyclictest0-21swapper/522:35:1411
483715992928,1cyclictest0-21swapper/519:55:4511
483712992928,1cyclictest0-21swapper/422:35:1410
483700992927,1cyclictest8147-21CPU0
483747992826,1cyclictest1393-21snmpd00:30:577
48374799280,27cyclictest0-21swapper/1522:03:287
48374799280,27cyclictest0-21swapper/1522:03:287
48374799280,27cyclictest0-21swapper/1500:06:537
48374799280,0cyclictest0-21swapper/1521:30:397
483745992828,0cyclictest0-21swapper/1420:36:376
48374599280,27cyclictest0-21swapper/1420:49:036
48374599280,27cyclictest0-21swapper/1420:10:516
483742992827,1cyclictest0-21swapper/1320:36:375
483739992827,1cyclictest1393-21snmpd23:40:224
48373999280,27cyclictest0-21swapper/1222:34:054
48373999280,27cyclictest0-21swapper/1222:12:044
48373999280,27cyclictest0-21swapper/1222:12:044
48373999280,27cyclictest0-21swapper/1221:05:054
48373599280,27cyclictest0-21swapper/1120:53:333
48373599280,1cyclictest0-21swapper/1120:39:463
483732992828,0cyclictest0-21swapper/1022:05:222
483732992828,0cyclictest0-21swapper/1022:05:222
483732992827,1cyclictest1393-21snmpd00:39:032
483732992826,1cyclictest1393-21snmpd23:14:542
483732992826,1cyclictest1393-21snmpd21:38:032
48373299280,27cyclictest0-21swapper/1022:36:352
48373299280,27cyclictest0-21swapper/1022:18:102
48373299280,27cyclictest0-21swapper/1021:34:242
483725992828,0cyclictest0-21swapper/819:25:2714
483725992826,1cyclictest1393-21snmpd23:28:0714
483725992824,3cyclictest1393-21snmpd22:01:4614
483725992824,3cyclictest1393-21snmpd22:01:4614
483722992828,0cyclictest0-21swapper/722:49:4413
48372299280,1cyclictest0-21swapper/700:11:0213
48372099283,25cyclictest0-21swapper/600:03:0212
48372099283,14cyclictest0-21swapper/621:51:1412
48372099283,14cyclictest0-21swapper/620:34:2212
48372099283,14cyclictest0-21swapper/619:28:2712
48372099280,27cyclictest0-21swapper/623:41:2812
483715992828,0cyclictest0-21swapper/522:27:5911
483715992828,0cyclictest0-21swapper/521:32:3911
48371599280,27cyclictest0-21swapper/519:30:2011
48371299280,1cyclictest0-21swapper/400:14:3510
483710992827,1cyclictest1393-21snmpd22:17:049
48371099280,27cyclictest0-21swapper/319:20:349
48370699280,27cyclictest0-21swapper/220:21:528
48370699280,1cyclictest0-21swapper/222:55:368
48370699280,1cyclictest0-21swapper/221:35:398
483703992826,1cyclictest1393-21snmpd20:35:191
483703992826,1cyclictest1393-21snmpd19:29:471
48370399280,27cyclictest0-21swapper/121:33:301
48370399280,1cyclictest0-21swapper/123:29:581
483700992826,1cyclictest8140-21CPU0
483700992826,1cyclictest1393-21snmpd21:12:440
483700992824,2cyclictest8141-21CPU0
483700992818,9cyclictest8146-21CPU0
483700992817,9cyclictest8142-21CPU0
48370099280,27cyclictest0-21swapper/020:50:380
48370099280,27cyclictest0-21swapper/019:17:580
483747992725,1cyclictest0-21swapper/1523:27:107
48374799270,27cyclictest0-21swapper/1523:07:037
483745992727,0cyclictest0-21swapper/1423:30:486
483745992727,0cyclictest0-21swapper/1422:40:326
483745992727,0cyclictest0-21swapper/1422:03:506
483745992727,0cyclictest0-21swapper/1422:03:506
48374599270,27cyclictest0-21swapper/1419:11:516
483742992725,1cyclictest1393-21snmpd22:56:035
483742992725,1cyclictest1393-21snmpd20:07:395
483742992725,1cyclictest1393-21snmpd19:56:545
483739992726,1cyclictest1393-21snmpd20:09:524
483739992726,1cyclictest1393-21snmpd00:25:514
483735992726,1cyclictest1393-21snmpd21:59:133
483735992717,9cyclictest0-21swapper/1121:36:313
483732992726,1cyclictest1393-21snmpd20:24:522
483732992725,1cyclictest1393-21snmpd20:26:192
48373299270,21cyclictest0-21swapper/1019:40:142
483730992726,1cyclictest1393-21snmpd23:55:2615
483730992725,1cyclictest1393-21snmpd23:09:4215
48373099270,1cyclictest0-21swapper/919:29:5615
483725992727,0cyclictest0-21swapper/821:23:5714
483725992727,0cyclictest0-21swapper/819:58:4914
483722992727,0cyclictest0-21swapper/720:37:5813
483722992726,1cyclictest1393-21snmpd19:41:5613
483722992725,1cyclictest1393-21snmpd19:13:4613
483720992726,1cyclictest0-21swapper/622:23:1912
48372099272,14cyclictest0-21swapper/600:14:0112
48371599270,27cyclictest0-21swapper/523:18:0311
483712992727,0cyclictest0-21swapper/422:27:5910
483712992727,0cyclictest0-21swapper/421:32:3910
483712992727,0cyclictest0-21swapper/419:55:4510
483712992726,1cyclictest1393-21snmpd22:20:5210
483712992726,1cyclictest1393-21snmpd22:11:4910
483712992726,1cyclictest1393-21snmpd22:11:4910
483710992725,1cyclictest1393-21snmpd20:52:299
483710992725,1cyclictest1393-21snmpd20:44:379
48371099270,1cyclictest0-21swapper/322:06:439
48371099270,1cyclictest0-21swapper/322:06:439
483706992725,1cyclictest1393-21snmpd22:35:118
483700992726,1cyclictest8137-21CPU0
483700992725,1cyclictest0-21swapper/021:32:390
483700992723,2cyclictest8141-21CPU0
483700992719,7cyclictest8138-21CPU0
483700992718,8cyclictest8141-21CPU0
483700992718,7cyclictest8140-21CPU0
48370099270,27cyclictest0-21swapper/019:32:530
483747992624,1cyclictest1393-21snmpd00:04:027
483745992624,1cyclictest1393-21snmpd00:00:146
483742992626,0cyclictest0-21swapper/1323:33:165
483742992626,0cyclictest0-21swapper/1322:53:185
483742992626,0cyclictest0-21swapper/1319:11:515
483742992625,1cyclictest398455-21kworker/13:1+mm_percpu_wq22:40:325
483742992625,1cyclictest1393-21snmpd00:14:475
483742992622,2cyclictest8141-21CPU5
483739992625,1cyclictest1393-21snmpd23:38:524
483739992625,1cyclictest1393-21snmpd22:21:374
483739992625,1cyclictest1393-21snmpd21:43:514
483739992624,1cyclictest1393-21snmpd00:24:184
483735992625,1cyclictest1393-21snmpd21:04:533
48373599261,19cyclictest0-21swapper/1121:47:123
48373599261,19cyclictest0-21swapper/1120:40:293
483735992610,10cyclictest8147-21CPU3
48373599260,18cyclictest0-21swapper/1120:02:453
483732992625,1cyclictest1393-21snmpd22:54:332
483732992625,1cyclictest1393-21snmpd21:40:182
483725992626,0cyclictest0-21swapper/823:54:0014
48372599260,0cyclictest0-21swapper/800:39:4214
483722992625,1cyclictest1393-21snmpd22:05:2513
483722992625,1cyclictest1393-21snmpd22:05:2513
483720992625,1cyclictest1393-21snmpd23:20:4912
483720992625,1cyclictest1393-21snmpd21:23:4112
483720992622,3cyclictest8139-21CPU12
483715992626,0cyclictest0-21swapper/500:16:1411
48371099260,25cyclictest0-21swapper/320:45:169
483706992624,1cyclictest1393-21snmpd23:11:488
48370699260,1cyclictest0-21swapper/219:47:058
483700992624,1cyclictest8140-21CPU0
483700992624,1cyclictest1393-21snmpd19:29:140
483700992620,5cyclictest8141-21CPU0
483700992619,5cyclictest8137-21CPU0
483700992619,5cyclictest8137-21CPU0
483747992523,1cyclictest0-21swapper/1519:10:407
483745992525,0cyclictest449447-21kworker/14:2+mm_percpu_wq20:17:176
483745992525,0cyclictest0-21swapper/1423:05:306
483745992524,1cyclictest859084-21kworker/u64:2+kvfree_rcu_reclaim00:39:426
483745992524,1cyclictest0-21swapper/1421:08:576
483745992524,1cyclictest0-21swapper/1419:25:276
48374599250,24cyclictest0-21swapper/1419:37:356
483742992525,0cyclictest0-21swapper/1322:03:505
483742992525,0cyclictest0-21swapper/1322:03:505
483742992525,0cyclictest0-21swapper/1320:49:035
483742992525,0cyclictest0-21swapper/1320:13:215
483742992523,1cyclictest8139-21CPU5
48373999250,19cyclictest0-21swapper/1221:54:544
48373599254,21cyclictest0-21swapper/1100:28:403
483735992516,9cyclictest0-21swapper/1122:23:543
48373599250,19cyclictest0-21swapper/1122:09:383
48373599250,19cyclictest0-21swapper/1122:09:383
48373599250,19cyclictest0-21swapper/1121:11:303
48373599250,19cyclictest0-21swapper/1100:33:363
48373299256,18cyclictest1264-21ntpd22:10:462
48373299256,18cyclictest1264-21ntpd22:10:462
483732992523,1cyclictest1393-21snmpd23:30:312
483732992523,1cyclictest1393-21snmpd21:19:082
483732992523,1cyclictest0-21swapper/1023:37:552
483730992525,0cyclictest0-21swapper/922:24:2215
48372599253,13cyclictest0-21swapper/820:08:1914
483725992524,1cyclictest1393-21snmpd19:37:1414
483725992523,1cyclictest1393-21snmpd21:29:3914
48372599250,24cyclictest0-21swapper/821:08:1414
48372599250,24cyclictest0-21swapper/820:37:5114
483715992523,1cyclictest8145-21CPU11
483715992523,1cyclictest8138-21CPU11
483715992523,1cyclictest1393-21snmpd20:40:5211
483710992523,1cyclictest0-21swapper/321:18:509
483706992523,1cyclictest0-21swapper/223:09:218
48370699250,18cyclictest0-21swapper/223:39:208
483703992524,1cyclictest1393-21snmpd23:36:311
48370399250,24cyclictest0-21swapper/123:02:571
48370399250,24cyclictest0-21swapper/121:36:421
483700992525,0cyclictest0-21swapper/022:35:140
483700992525,0cyclictest0-21swapper/019:55:450
483700992521,2cyclictest8141-21CPU0
483700992519,5cyclictest8137-21CPU0
483700992518,5cyclictest8147-21CPU0
483700992518,5cyclictest8138-21CPU0
48374799240,19cyclictest0-21swapper/1519:31:597
48374599245,18cyclictest8140-21CPU6
48374599243,19cyclictest8141-21CPU6
483745992424,0cyclictest0-21swapper/1423:43:026
483745992424,0cyclictest0-21swapper/1420:32:456
483745992424,0cyclictest0-21swapper/1420:06:436
483745992424,0cyclictest0-21swapper/1419:58:496
483745992424,0cyclictest0-21swapper/1400:23:386
483745992422,1cyclictest8143-21CPU6
483742992423,1cyclictest0-21swapper/1323:05:305
48374299240,18cyclictest0-21swapper/1300:00:295
483739992423,1cyclictest1393-21snmpd22:46:354
483735992416,6cyclictest0-21swapper/1122:16:423
48373599240,23cyclictest0-21swapper/1119:21:273
48373599240,18cyclictest0-21swapper/1123:39:203
48373599240,18cyclictest0-21swapper/1121:27:513
48373299240,0cyclictest0-21swapper/1023:29:342
483730992423,1cyclictest0-21swapper/900:05:3515
483730992422,1cyclictest8137-21CPU15
483725992423,1cyclictest4100190-21kworker/8:2-mm_percpu_wq23:42:5914
483725992422,1cyclictest1393-21snmpd23:00:0314
483722992423,1cyclictest1393-21snmpd00:16:5613
483720992423,1cyclictest0-21swapper/621:10:1412
483715992423,1cyclictest1393-21snmpd22:22:3411
48371299246,1cyclictest8146-21CPU10
483712992424,0cyclictest0-21swapper/400:16:1410
48371099246,17cyclictest8145-21CPU9
483710992424,0cyclictest0-21swapper/300:12:489
483710992423,1cyclictest0-21swapper/322:13:239
483710992423,1cyclictest0-21swapper/322:13:229
48370699245,18cyclictest8138-21CPU8
483706992422,1cyclictest1393-21snmpd19:38:508
48370699240,0cyclictest0-21swapper/221:20:148
483703992423,1cyclictest1393-21snmpd20:02:031
483703992423,1cyclictest0-21swapper/100:17:321
48370399240,23cyclictest0-21swapper/123:11:431
48370399240,0cyclictest0-21swapper/120:44:231
483700992424,0cyclictest0-21swapper/022:12:280
483700992424,0cyclictest0-21swapper/022:12:280
483700992420,3cyclictest8141-21CPU0
483700992419,4cyclictest8137-21CPU0
483747992322,1cyclictest1393-21snmpd19:27:447
483747992321,1cyclictest8146-21CPU7
483745992323,0cyclictest0-21swapper/1423:54:016
483745992323,0cyclictest0-21swapper/1422:39:206
483745992323,0cyclictest0-21swapper/1421:23:576
483745992323,0cyclictest0-21swapper/1421:16:266
483745992321,1cyclictest8139-21CPU6
48374599231,20cyclictest8138-21CPU6
48374599230,23cyclictest0-21swapper/1422:27:266
483742992323,0cyclictest0-21swapper/1300:39:425
483742992322,1cyclictest1393-21snmpd00:27:395
483742992322,1cyclictest0-21swapper/1319:25:275
483742992321,1cyclictest8142-21CPU5
483742992316,5cyclictest0-21swapper/1321:31:215
48374299230,0cyclictest0-21swapper/1319:47:595
48373999235,1cyclictest8145-21CPU4
483739992322,1cyclictest1393-21snmpd22:57:134
483735992322,1cyclictest1393-21snmpd22:52:203
483735992322,1cyclictest0-21swapper/1121:51:153
483735992315,8cyclictest0-21swapper/1121:31:353
483735992314,9cyclictest0-21swapper/1123:28:223
48373599230,18cyclictest0-21swapper/1119:40:213
483732992322,1cyclictest0-21swapper/1022:30:142
483732992317,3cyclictest0-21swapper/1021:47:252
48373099235,2cyclictest8138-21CPU15
483730992322,1cyclictest0-21swapper/923:34:0715
483730992322,1cyclictest0-21swapper/920:16:3715
48372599234,18cyclictest1393-21snmpd19:13:4914
483725992322,0cyclictest0-21swapper/821:01:0514
483725992321,1cyclictest0-21swapper/820:02:2414
483722992322,1cyclictest0-21swapper/723:30:0113
483722992322,1cyclictest0-21swapper/722:59:3613
483722992321,1cyclictest1393-21snmpd23:51:5213
483720992322,1cyclictest0-21swapper/600:29:4512
483720992321,1cyclictest8144-21CPU12
483720992320,2cyclictest8147-21CPU12
48372099230,12cyclictest0-21swapper/620:56:1912
483715992322,1cyclictest8137-21CPU11
483715992322,1cyclictest8127-21qemu-system-x8600:31:0911
483715992322,1cyclictest1393-21snmpd21:05:2311
483715992322,1cyclictest0-21swapper/521:42:3911
48371599230,5cyclictest8145-21CPU11
48371599230,20cyclictest0-21swapper/520:20:0211
483712992322,1cyclictest1393-21snmpd23:46:3410
483712992322,1cyclictest1393-21snmpd23:03:2410
483712992322,1cyclictest0-21swapper/423:50:1310
483712992322,1cyclictest0-21swapper/419:22:5310
483710992322,1cyclictest1393-21snmpd23:04:039
483710992322,1cyclictest1393-21snmpd22:45:479
483710992322,1cyclictest1393-21snmpd21:54:579
483706992322,1cyclictest1393-21snmpd20:36:558
483706992322,1cyclictest0-21swapper/200:24:008
483706992321,1cyclictest8145-21CPU8
483706992321,1cyclictest8145-21CPU8
483703992322,1cyclictest1393-21snmpd00:20:291
483703992322,1cyclictest0-21swapper/121:51:181
483703992322,1cyclictest0-21swapper/119:14:161
483703992321,1cyclictest1393-21snmpd21:45:121
483703992321,1cyclictest0-21swapper/122:08:101
483703992321,1cyclictest0-21swapper/122:08:101
483700992322,1cyclictest0-21swapper/023:27:010
483700992322,1cyclictest0-21swapper/022:50:350
483700992322,1cyclictest0-21swapper/000:08:530
483700992320,2cyclictest8144-21CPU0
483700992320,2cyclictest8144-21CPU0
483700992320,2cyclictest8140-21CPU0
483700992318,3cyclictest8142-21CPU0
48374799225,15cyclictest8141-21CPU7
483747992220,1cyclictest8147-21CPU7
483747992219,2cyclictest8145-21CPU7
48374799221,2cyclictest8138-21CPU7
48374799221,19cyclictest8138-21CPU7
483745992222,0cyclictest0-21swapper/1421:11:306
483745992220,1cyclictest8147-21CPU6
483745992219,1cyclictest8144-21CPU6
48374599220,3cyclictest8137-21CPU6
48374599220,19cyclictest8147-21CPU6
483742992222,0cyclictest0-21swapper/1323:54:005
483742992222,0cyclictest0-21swapper/1323:43:025
483742992222,0cyclictest0-21swapper/1321:23:575
483742992222,0cyclictest0-21swapper/1321:08:575
483742992222,0cyclictest0-21swapper/1320:32:455
483742992222,0cyclictest0-21swapper/1300:23:385
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional