You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-28 - 22:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot1.osadl.org (updated Sat Jun 28, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2795521690,0sleep20-21swapper/210:30:052
2795521690,0sleep20-21swapper/210:30:052
1483421640,0sleep60-21swapper/610:36:106
329521500,0sleep60-21swapper/607:29:256
3172321470,0sleep00-21swapper/011:58:490
3172321470,0sleep00-21swapper/011:58:490
2351621450,1sleep43268499cyclictest09:44:564
554921430,1sleep55449-21chk_conn_tcp11:05:585
248021430,3sleep03268099cyclictest09:05:020
502221410,2sleep23268299cyclictest10:44:072
1613621410,0sleep20-21swapper/212:04:442
2531221400,0sleep20-21swapper/211:23:422
630021380,2sleep33268399cyclictest07:58:063
1588121380,0sleep20-21swapper/209:09:282
326849913632,61cyclictest16043-21pool-13-thread-07:50:404
286221330,0sleep30-21swapper/312:21:443
370121320,0sleep20-21swapper/212:11:012
32683991325,45cyclictest0-21swapper/310:51:583
3062821320,1sleep43268499cyclictest09:14:194
32682991305,63cyclictest11654-21missed_timers08:55:542
2594021250,2sleep13268199cyclictest10:07:041
2594021250,2sleep13268199cyclictest10:07:041
1813521250,0sleep70-21swapper/711:43:027
430321230,0sleep60-21swapper/611:05:516
326849912311,16cyclictest0-21swapper/411:15:284
1285621230,1sleep23268299cyclictest08:42:202
1117421220,2sleep13268199cyclictest07:32:161
326829912013,41cyclictest0-21swapper/209:23:092
326839911914,39cyclictest0-21swapper/311:21:533
3044621190,0sleep60-21swapper/610:19:596
2125221180,0sleep60-21swapper/609:21:506
2233521170,0sleep341-21rcuc/309:55:373
2233521170,0sleep341-21rcuc/309:55:373
3100321160,1sleep123-21rcuc/111:14:511
1319121160,0sleep60-21swapper/610:57:336
887821150,1sleep341-21rcuc/308:40:533
1953321150,0sleep30-21swapper/308:17:293
326839911433,10cyclictest23450-21chk_conn_tcp07:37:403
326829911427,22cyclictest13950irq/24-ahci[00010:09:062
326829911427,22cyclictest13950irq/24-ahci[00010:09:062
326849911045,24cyclictest0-21swapper/410:19:154
326839910911,40cyclictest0-21swapper/310:17:073
1122621090,3sleep33268399cyclictest07:32:183
326849910829,0cyclictest0-21swapper/412:06:144
326839910712,57cyclictest27198-21pool-14-thread-08:49:293
326829910746,25cyclictest16495-21chk_conn_tcp09:27:582
1738121070,0sleep70-21swapper/710:59:197
326849910618,37cyclictest0-21swapper/408:10:264
32683991069,31cyclictest0-21swapper/307:20:343
32683991047,20cyclictest0-21swapper/311:44:523
32683991046,21cyclictest0-21swapper/312:18:323
32682991040,35cyclictest0-21swapper/209:10:522
3235621040,0sleep60-21swapper/612:10:176
2094121040,3sleep33268399cyclictest07:09:033
326849910339,9cyclictest0-21swapper/411:42:124
326839910339,20cyclictest0-21swapper/311:34:433
326829910324,42cyclictest0-21swapper/207:07:132
1373621030,0sleep60-21swapper/612:03:446
326849910240,36cyclictest0-21swapper/409:05:314
326849910225,28cyclictest0-21swapper/411:01:034
326829910015,24cyclictest3730-21watchprog-ntop07:43:012
3268399999,42cyclictest27157-21openvpn08:30:123
3268399999,42cyclictest27157-21openvpn08:30:123
32683999913,1cyclictest43-21ksoftirqd/309:26:223
104032990,0sleep50-21swapper/510:56:365
32683999728,40cyclictest0-21swapper/309:03:553
32683999643,17cyclictest20980-21diskmemload09:43:273
32684999524,20cyclictest0-21swapper/408:43:334
32683999540,1cyclictest3730-21watchprog-ntop08:14:423
32684999423,17cyclictest0-21swapper/411:57:094
32684999423,17cyclictest0-21swapper/411:57:094
32684999354,3cyclictest32594-21QueuingRrdStrat11:35:154
32684999214,18cyclictest0-21swapper/411:07:284
32683999217,17cyclictest0-21swapper/311:14:563
32684999111,0cyclictest0-21swapper/411:47:004
32682999135,39cyclictest0-21swapper/207:24:512
178152910,0sleep10-21swapper/110:59:291
32682999013,37cyclictest3730-21watchprog-ntop10:34:132
32684998910,17cyclictest0-21swapper/407:07:454
32683998921,32cyclictest3730-21watchprog-ntop11:17:373
3268299886,1cyclictest0-21swapper/211:55:012
32682998828,9cyclictest0-21swapper/208:31:482
32682998828,9cyclictest0-21swapper/208:31:482
32684998724,40cyclictest0-21swapper/409:24:454
32684998721,8cyclictest10629-21chk_conn_tcp07:18:264
32683998732,32cyclictest0-21swapper/310:13:553
32683998732,32cyclictest0-21swapper/310:13:553
32682998726,17cyclictest0-21swapper/210:52:302
32684998615,31cyclictest0-21swapper/407:25:234
32683998642,24cyclictest23479-21chk_conn_tcp10:39:343
3268299865,22cyclictest0-21swapper/211:03:432
32683998544,21cyclictest0-21swapper/310:00:333
32683998533,12cyclictest24886-21pool-13-thread-12:09:593
32682998549,18cyclictest16495-21chk_conn_tcp08:27:002
32682998549,18cyclictest16495-21chk_conn_tcp08:27:002
32682998530,38cyclictest0-21swapper/211:47:322
3268299850,31cyclictest0-21swapper/207:05:042
3268299844,58cyclictest0-21swapper/210:37:262
3268299842,56cyclictest0-21swapper/212:26:322
3268499831,59cyclictest0-21swapper/410:25:404
3268499831,59cyclictest0-21swapper/410:25:404
3268399836,41cyclictest0-21swapper/310:34:453
32683998323,16cyclictest3730-21watchprog-ntop10:26:123
32683998323,16cyclictest3730-21watchprog-ntop10:26:123
32684998219,52cyclictest3730-21watchprog-ntop09:36:314
32684998219,52cyclictest3730-21watchprog-ntop09:36:314
32683998239,42cyclictest3730-21watchprog-ntop10:56:463
32683998233,28cyclictest4430-21DefaultUDPTrans07:43:333
32682998247,14cyclictest3730-21watchprog-ntop10:59:592
275282820,1sleep327527-21chk_conn_tcp08:20:583
32683998120,54cyclictest0-21swapper/311:37:233
3268099817,55cyclictest0-21swapper/008:50:330
3268499804,23cyclictest0-21swapper/410:31:334
32684997939,4cyclictest0-21swapper/408:23:474
32684997913,1cyclictest0-21swapper/408:15:464
3268499790,13cyclictest0-21swapper/408:35:334
3268499790,13cyclictest0-21swapper/408:35:334
32683997918,2cyclictest16495-21chk_conn_tcp11:49:403
240872790,1sleep723983-21chk_conn_tcp07:10:357
3268499789,1cyclictest0-21swapper/410:10:434
3268499789,1cyclictest0-21swapper/410:10:434
32684997819,0cyclictest0-21swapper/412:12:074
32683997816,1cyclictest0-21swapper/309:16:123
32682997822,40cyclictest0-21swapper/211:12:482
32682997817,14cyclictest3730-21watchprog-ntop07:29:072
32682997738,0cyclictest16165-21chk_conn_tcp11:58:452
32682997738,0cyclictest16165-21chk_conn_tcp11:58:452
3268299770,43cyclictest0-21swapper/210:01:382
3268299770,43cyclictest0-21swapper/210:01:382
32684997638,17cyclictest0-21swapper/410:21:564
32684997638,17cyclictest0-21swapper/410:21:564
32684997618,1cyclictest0-21swapper/409:58:254
32684997615,1cyclictest0-21swapper/412:29:134
32684997614,1cyclictest0-21swapper/408:50:014
10542760,6sleep0188850irq/25-eth009:26:010
94832750,1sleep450-21rcuc/410:45:544
3268299755,30cyclictest0-21swapper/208:36:052
32682997517,3cyclictest28728-21chk_conn_tcp09:46:082
32684997420,37cyclictest24170-21Poller-Thread-207:31:154
32683997430,25cyclictest0-21swapper/307:49:363
32683997413,11cyclictest0-21swapper/310:25:083
32683997413,11cyclictest0-21swapper/310:25:083
32683997410,25cyclictest0-21swapper/312:30:173
32680997472,1cyclictest0-21swapper/010:05:220
32680997472,1cyclictest0-21swapper/010:05:220
32683997333,24cyclictest0-21swapper/309:38:393
32683997333,24cyclictest0-21swapper/309:38:393
32683997314,24cyclictest3730-21watchprog-ntop09:06:033
3268099732,39cyclictest0-21swapper/009:58:570
160962730,0sleep10-21swapper/108:57:421
117752730,2sleep7781ktimersoftd/711:19:147
84122720,1sleep013-21rcuc/011:29:000
32992720,1sleep620980-21diskmemload11:37:566
3268799720,51cyclictest0-21swapper/707:12:017
3268699721,20cyclictest16495-21chk_conn_tcp07:59:136
32684997213,1cyclictest0-21swapper/410:05:544
32684997213,1cyclictest0-21swapper/410:05:544
32682997212,51cyclictest0-21swapper/212:25:282
191082720,1sleep73729-21runrttasks10:37:477
32687997130,40cyclictest0-21swapper/708:25:237
32687997116,39cyclictest0-21swapper/711:46:287
3268499717,23cyclictest0-21swapper/410:37:584
32680997131,23cyclictest3730-21watchprog-ntop09:15:080
83752700,0sleep00-21swapper/008:54:520
3268499709,2cyclictest16495-21chk_conn_tcp08:55:224
32684997017,23cyclictest0-21swapper/412:04:064
32684997012,57cyclictest0-21swapper/412:16:554
32683997016,44cyclictest0-21swapper/309:21:333
32682997037,22cyclictest0-21swapper/211:33:072
32682997021,17cyclictest0-21swapper/208:20:352
32680997014,42cyclictest0-21swapper/007:35:320
3268799698,40cyclictest0-21swapper/707:59:457
32687996932,22cyclictest0-21swapper/710:42:147
32687996926,5cyclictest22517-21G107:43:157
32687996913,25cyclictest0-21swapper/711:04:477
32684996924,23cyclictest0-21swapper/409:48:164
3268299695,21cyclictest0-21swapper/208:07:132
32680996911,42cyclictest0-21swapper/007:46:550
224062690,0sleep60-21swapper/608:32:396
224062690,0sleep60-21swapper/608:32:396
3268799689,35cyclictest26654-21nioEventLoopGro09:18:537
3268799686,21cyclictest3730-21watchprog-ntop10:15:317
3268799686,21cyclictest3730-21watchprog-ntop10:15:317
32687996833,14cyclictest3730-21watchprog-ntop11:28:507
32687996812,37cyclictest0-21swapper/707:17:547
32684996810,4cyclictest0-21swapper/409:54:414
32684996810,4cyclictest0-21swapper/409:54:414
32682996823,18cyclictest0-21swapper/208:54:502
32682996812,9cyclictest0-21swapper/207:10:572
32680996826,4cyclictest0-21swapper/007:23:460
241842680,0sleep00-21swapper/007:10:360
123012680,0sleep00-21swapper/008:28:320
123012680,0sleep00-21swapper/008:28:320
82512670,1sleep70-21swapper/710:23:137
82512670,1sleep70-21swapper/710:23:137
3268799677,20cyclictest3730-21watchprog-ntop10:33:417
32687996711,36cyclictest0-21swapper/707:31:477
32683996714,41cyclictest0-21swapper/310:02:423
32683996714,41cyclictest0-21swapper/310:02:423
32682996731,31cyclictest31140-21ssh10:20:202
3268099676,51cyclictest0-21swapper/008:05:370
32680996711,36cyclictest0-21swapper/011:10:400
278442670,0sleep70-21swapper/707:25:497
202752670,3sleep23268299cyclictest12:16:462
32686996660,5cyclictest0-21swapper/609:49:526
3268499667,23cyclictest0-21swapper/409:19:254
3268499666,29cyclictest0-21swapper/411:16:334
32682996646,17cyclictest0-21swapper/209:54:092
32682996646,17cyclictest0-21swapper/209:54:092
32680996656,9cyclictest16165-21chk_conn_tcp07:01:520
32680996628,18cyclictest3730-21watchprog-ntop10:07:300
32680996628,18cyclictest3730-21watchprog-ntop10:07:300
32680996624,10cyclictest0-21swapper/010:23:320
32680996624,10cyclictest0-21swapper/010:23:320
32680996622,16cyclictest0-21swapper/007:42:290
261632660,1sleep13729-21runrttasks07:52:361
213132660,0sleep13268199cyclictest10:49:511
186852660,3sleep518678-21chk_conn_tcp10:26:405
186852660,3sleep518678-21chk_conn_tcp10:26:405
131452660,1sleep53268599cyclictest10:25:115
131452660,1sleep53268599cyclictest10:25:115
63152650,1sleep324645-21Collectd-Thread08:40:133
3268799655,41cyclictest3730-21watchprog-ntop08:19:317
3268499654,21cyclictest0-21swapper/407:02:244
3268099658,33cyclictest9679-21chk_conn_tcp09:50:560
3268099658,33cyclictest9679-21chk_conn_tcp09:50:560
32680996563,1cyclictest0-21swapper/009:30:380
32680996517,0cyclictest8040-21chk_conn_tcp07:16:500
322492650,0sleep50-21swapper/509:58:355
91782640,1sleep13268199cyclictest09:28:581
32687996424,18cyclictest0-21swapper/709:29:347
32687996417,32cyclictest0-21swapper/711:38:277
32687996414,36cyclictest22433-21G107:43:157
32683996424,2cyclictest0-21swapper/307:12:333
3268299646,57cyclictest0-21swapper/209:35:592
3268299646,57cyclictest0-21swapper/209:35:592
3268099644,20cyclictest188850irq/25-eth011:53:570
192222640,0sleep00-21swapper/011:32:210
11792640,0sleep10-21swapper/107:41:381
32684996315,33cyclictest0-21swapper/409:26:544
32680996342,17cyclictest3189-21postmaster07:56:000
3268099631,49cyclictest188850irq/25-eth010:30:290
3268099631,49cyclictest188850irq/25-eth010:30:290
307102630,0sleep70-21swapper/709:57:577
246422630,0sleep60-21swapper/611:12:166
224552630,0sleep70-21swapper/708:32:407
224552630,0sleep70-21swapper/708:32:407
32684996218,8cyclictest0-21swapper/411:36:514
32684996216,45cyclictest27157-21openvpn07:59:134
32683996224,1cyclictest0-21swapper/307:23:143
3268399621,41cyclictest0-21swapper/310:06:583
3268399621,41cyclictest0-21swapper/310:06:583
32682996223,1cyclictest27157-21openvpn11:41:392
32680996221,37cyclictest188850irq/25-eth009:40:150
32680996221,37cyclictest188850irq/25-eth009:40:150
32680996217,43cyclictest23216-21chk_conn_tcp09:22:370
229532620,3sleep53268599cyclictest09:00:505
120682620,1sleep612067-21chk_conn_tcp11:19:216
32687996116,44cyclictest0-21swapper/708:15:147
3268499614,41cyclictest14342-21chk_conn_tcp11:21:214
216622610,1sleep014342-21chk_conn_tcp09:44:120
138882610,0sleep10-21swapper/110:03:201
138882610,0sleep10-21swapper/110:03:201
7232600,1sleep73729-21runrttasks10:53:347
32687996020,20cyclictest0-21swapper/709:48:487
3268299600,59cyclictest0-21swapper/211:09:362
3268099606,0cyclictest3730-21watchprog-ntop10:48:390
3268099601,39cyclictest16165-21chk_conn_tcp11:06:560
152532600,0sleep70-21swapper/710:47:177
61452590,3sleep73268799cyclictest07:44:327
55332590,1sleep60-21swapper/607:15:556
3268799592,56cyclictest214550irq/30-eth2-TxR08:46:147
32687995921,11cyclictest3730-21watchprog-ntop12:27:057
3268399590,39cyclictest3730-21watchprog-ntop11:05:193
32682995954,4cyclictest13950irq/24-ahci[00009:59:292
3268299591,39cyclictest0-21swapper/207:32:522
32680995925,19cyclictest0-21swapper/008:18:270
32680995913,28cyclictest0-21swapper/008:41:570
215092590,1sleep10-21swapper/106:55:471
32687995834,19cyclictest214550irq/30-eth2-TxR09:21:017
32687995810,34cyclictest0-21swapper/708:08:507
32684995822,34cyclictest4795-21DefaultUDPTrans08:39:174
32682995849,3cyclictest13950irq/24-ahci[00011:37:552
32680995852,5cyclictest188850irq/25-eth012:07:500
32680995818,3cyclictest0-21swapper/008:03:290
207572580,0sleep50-21swapper/511:44:125
109732580,0sleep70-21swapper/708:27:437
109732580,0sleep70-21swapper/708:27:437
32687995731,20cyclictest17992-21httpd09:53:057
32687995731,20cyclictest17992-21httpd09:53:057
3268699572,35cyclictest32594-21QueuingRrdStrat07:33:246
32686995716,35cyclictest3641-21chk_conn_tcp09:05:316
32684995718,17cyclictest16495-21chk_conn_tcp09:07:394
32684995715,41cyclictest0-21swapper/412:20:404
23732570,1sleep668-21rcuc/607:15:156
32687995639,16cyclictest3730-21watchprog-ntop08:02:577
32687995621,18cyclictest0-21swapper/709:13:327
32687995615,40cyclictest0-21swapper/712:11:357
32687995614,21cyclictest0-21swapper/712:22:487
32686995618,36cyclictest12092-21postmaster08:40:536
32684995623,16cyclictest0-21swapper/408:00:494
32684995621,16cyclictest0-21swapper/407:14:094
32687995516,17cyclictest0-21swapper/708:41:257
32686995514,39cyclictest0-21swapper/609:52:006
32686995514,39cyclictest0-21swapper/609:52:006
3268499552,0cyclictest14342-21chk_conn_tcp09:32:144
3268499550,41cyclictest16495-21chk_conn_tcp07:50:084
32680995523,15cyclictest0-21swapper/012:15:510
282572550,2sleep54673-21chk_conn_tcp10:51:395
221962550,0sleep70-21swapper/710:27:547
221962550,0sleep70-21swapper/710:27:547
32686995418,35cyclictest4673-21chk_conn_tcp09:43:276
3268299543,38cyclictest0-21swapper/207:17:222
32680995427,26cyclictest188850irq/25-eth011:24:340
32680995418,17cyclictest0-21swapper/012:03:020
3268099540,35cyclictest0-21swapper/010:32:370
70392530,0sleep60-21swapper/608:54:026
32687995326,26cyclictest16495-21chk_conn_tcp12:01:267
32686995351,1cyclictest0-21swapper/609:38:076
32686995351,1cyclictest0-21swapper/609:38:076
32686995320,32cyclictest23804-21chk_conn_tcp08:20:036
32684995312,40cyclictest0-21swapper/410:50:504
32683995310,24cyclictest4669-21chk_conn_tcp07:30:113
32682995329,6cyclictest16495-21chk_conn_tcp10:12:512
32682995329,6cyclictest16495-21chk_conn_tcp10:12:512
32682995317,15cyclictest0-21swapper/209:45:362
3268099530,12cyclictest0-21swapper/008:23:150
3268699529,42cyclictest0-21swapper/607:25:236
3268299523,43cyclictest0-21swapper/211:28:182
226002520,1sleep234-21ksoftirqd/206:55:562
59702510,1sleep13268199cyclictest10:44:301
32686995125,25cyclictest0-21swapper/610:06:586
32686995125,25cyclictest0-21swapper/610:06:586
32686995120,30cyclictest780-21chk_conn_tcp09:58:576
32680995133,17cyclictest0-21swapper/008:10:580
32680995131,19cyclictest0-21swapper/009:09:160
148392510,0sleep20-21swapper/211:20:292
52282500,0sleep10-21swapper/111:38:471
32680995012,1cyclictest0-21swapper/010:57:180
299462500,0sleep50-21swapper/509:35:515
299462500,0sleep50-21swapper/509:35:515
32687994928,0cyclictest0-21swapper/710:03:147
32687994928,0cyclictest0-21swapper/710:03:147
32684994930,1cyclictest0-21swapper/410:45:264
32682994948,0cyclictest13950irq/24-ahci[00007:59:132
32680994923,19cyclictest0-21swapper/011:48:040
32680994911,37cyclictest188850irq/25-eth010:54:060
189972490,0sleep10-21swapper/107:08:051
49812480,0sleep10-21swapper/110:55:121
32687994824,15cyclictest0-21swapper/708:52:107
3268299480,12cyclictest0-21swapper/210:48:072
257712480,0sleep10-21swapper/108:47:561
120362480,0sleep10-21swapper/107:19:101
79832470,0sleep50-21swapper/511:28:495
3268799475,35cyclictest16165-21chk_conn_tcp11:51:177
32683994721,25cyclictest0-21swapper/311:54:293
3268399471,24cyclictest0-21swapper/311:10:083
3268299473,39cyclictest0-21swapper/207:48:312
32680994745,1cyclictest188850irq/25-eth009:16:120
3268799465,0cyclictest0-21swapper/712:07:507
32687994610,0cyclictest0-21swapper/708:56:267
3268699468,37cyclictest0-21swapper/608:21:396
32686994622,23cyclictest5299-21chk_conn_tcp10:33:096
32686994619,26cyclictest0-21swapper/607:54:246
17642460,0sleep10-21swapper/111:26:211
3268699458,36cyclictest0-21swapper/608:07:466
32686994543,1cyclictest32189-21chk_conn_tcp09:25:496
32686994525,19cyclictest0-21swapper/611:52:536
3268799445,1cyclictest214550irq/30-eth2-TxR09:41:517
3268699448,31cyclictest0-21swapper/610:43:506
32686994442,1cyclictest2515-21chk_conn_tcp11:26:426
32686994442,1cyclictest0-21swapper/610:24:046
32686994442,1cyclictest0-21swapper/610:24:046
32686994423,20cyclictest9238-21nping09:17:496
32686994413,16cyclictest0-21swapper/612:29:456
32684994442,1cyclictest27157-21openvpn07:44:474
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional