You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-25 - 23:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot1.osadl.org (updated Tue Mar 25, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293721810,1sleep41839899cyclictest10:59:254
293721810,1sleep41839899cyclictest10:59:254
2359421610,2sleep61840099cyclictest07:50:256
1951521590,1sleep72269-21Poller-Thread-111:28:287
526821540,3sleep51839999cyclictest07:27:405
483021530,0sleep41839899cyclictest11:57:024
3225121500,0sleep70-21swapper/710:12:247
3036721500,2sleep01839399cyclictest09:49:180
2341621460,1sleep51839999cyclictest07:21:315
1129221430,1sleep24673-21chk_conn_tcp10:28:062
2535521420,2sleep61840099cyclictest11:53:196
2193621420,0sleep20-21swapper/207:49:252
183949914221,44cyclictest0-21swapper/109:45:441
183949914221,44cyclictest0-21swapper/109:45:441
3231221410,2sleep01839399cyclictest11:56:100
1162021400,1sleep31839799cyclictest07:45:013
3063721360,1sleep51839999cyclictest11:32:035
2252921330,0sleep222478-21chk_conn_tcp09:23:482
2252921330,0sleep222478-21chk_conn_tcp09:23:482
1726521320,1sleep417261-21chk_conn_tcp10:30:404
183949913148,26cyclictest2452-21openvpn10:11:231
2220521290,1sleep04673-21chk_conn_tcp11:17:240
327821280,0sleep40-21swapper/411:34:104
2580621270,0sleep20-21swapper/208:05:192
184009912433,39cyclictest0-21swapper/609:50:006
598521230,1sleep05982-21chk_conn_tcp08:51:490
987921220,0sleep50-21swapper/511:36:205
183949912223,24cyclictest4673-21chk_conn_tcp08:51:101
359721200,0sleep50-21swapper/510:36:265
183949912011,57cyclictest16495-21chk_conn_tcp09:09:221
183949912011,57cyclictest16495-21chk_conn_tcp09:09:221
184019911634,32cyclictest3730-21watchprog-ntop08:14:447
183989911536,38cyclictest3730-21watchprog-ntop08:05:394
183949911537,17cyclictest18390-21cyclictest09:22:451
183949911537,17cyclictest18390-21cyclictest09:22:451
183989911430,13cyclictest2452-21openvpn09:06:414
183989911430,13cyclictest2452-21openvpn09:06:414
184009911331,1cyclictest0-21swapper/609:53:136
184009911331,1cyclictest0-21swapper/609:53:136
168521130,0sleep20-21swapper/211:33:362
769721110,0sleep40-21swapper/408:11:144
184009911122,42cyclictest0-21swapper/610:09:476
18398991118,55cyclictest0-21swapper/407:12:454
18397991116,45cyclictest0-21swapper/311:07:293
18397991116,45cyclictest0-21swapper/311:07:293
184009911010,81cyclictest0-21swapper/611:33:406
183979911055,39cyclictest2265-21Poller-Thread-809:20:053
183979911055,39cyclictest2265-21Poller-Thread-809:20:053
183979911031,18cyclictest3730-21watchprog-ntop07:30:233
183949911025,47cyclictest0-21swapper/110:50:551
18397991097,16cyclictest0-21swapper/308:22:133
184009910711,40cyclictest0-21swapper/607:36:486
183939910710,60cyclictest0-21swapper/010:39:100
183979910627,23cyclictest3730-21watchprog-ntop10:16:433
183949910622,15cyclictest0-21swapper/108:38:471
184019910445,29cyclictest0-21swapper/707:07:257
183979910426,53cyclictest0-21swapper/310:41:503
183979910419,42cyclictest0-21swapper/311:49:103
1050021040,0sleep00-21swapper/007:58:040
183989910318,31cyclictest0-21swapper/409:12:044
183989910318,31cyclictest0-21swapper/409:12:044
184009910265,9cyclictest3730-21watchprog-ntop12:21:456
184009910215,41cyclictest0-21swapper/607:17:026
183989910228,27cyclictest3730-21watchprog-ntop08:46:484
18393991026,41cyclictest1401-21chk_conn_tcp10:25:160
18393991024,17cyclictest0-21swapper/012:28:420
183939910224,57cyclictest0-21swapper/009:33:590
184009910133,45cyclictest4673-21chk_conn_tcp10:56:486
184009910133,45cyclictest4673-21chk_conn_tcp10:56:486
183939910137,39cyclictest3730-21watchprog-ntop11:31:320
183979910018,47cyclictest0-21swapper/312:16:253
183939910016,44cyclictest0-21swapper/008:02:590
18397999915,40cyclictest0-21swapper/312:28:103
18397999912,51cyclictest3730-21watchprog-ntop10:30:053
18394999916,19cyclictest3730-21watchprog-ntop07:40:321
1839499990,31cyclictest0-21swapper/111:48:381
1839399990,21cyclictest0-21swapper/007:24:300
18401999819,22cyclictest0-21swapper/707:38:247
18398999833,26cyclictest16495-21chk_conn_tcp10:37:344
18394999817,35cyclictest0-21swapper/110:33:491
18394999812,36cyclictest0-21swapper/112:29:461
18397999724,72cyclictest0-21swapper/309:55:533
18397999724,72cyclictest0-21swapper/309:55:533
18394999735,19cyclictest214750irq/32-eth2-TxR09:01:211
18393999719,51cyclictest0-21swapper/008:08:190
1839399970,20cyclictest0-21swapper/010:06:340
18401999615,19cyclictest2761-21Collectd-Thread08:31:187
18401999615,19cyclictest2761-21Collectd-Thread08:31:187
18397999612,63cyclictest3730-21watchprog-ntop08:12:043
18394999614,50cyclictest0-21swapper/110:53:031
1839399960,34cyclictest0-21swapper/009:37:430
18400999510,41cyclictest0-21swapper/612:00:556
18398999536,57cyclictest3730-21watchprog-ntop11:20:514
1839799950,39cyclictest16165-21chk_conn_tcp09:07:453
1839799950,39cyclictest16165-21chk_conn_tcp09:07:453
18394999540,14cyclictest0-21swapper/111:22:271
18400999440,18cyclictest3730-21watchprog-ntop09:25:266
18400999440,18cyclictest3730-21watchprog-ntop09:25:266
18398999492,1cyclictest511ktimersoftd/407:27:434
18398999433,19cyclictest0-21swapper/410:33:174
18398999432,4cyclictest0-21swapper/409:36:074
18393999435,39cyclictest0-21swapper/008:20:040
18400999310,21cyclictest0-21swapper/608:23:176
18398999328,41cyclictest0-21swapper/407:57:384
18398999315,34cyclictest0-21swapper/411:01:364
1839799938,25cyclictest0-21swapper/308:31:503
1839799938,25cyclictest0-21swapper/308:31:503
18397999347,40cyclictest0-21swapper/312:26:023
18394999317,17cyclictest5211-21pool-13-thread-08:16:201
18394999314,42cyclictest0-21swapper/109:32:541
18400999231,37cyclictest0-21swapper/607:51:456
18400999217,51cyclictest0-21swapper/610:40:146
18398999214,54cyclictest0-21swapper/408:43:044
18394999238,0cyclictest12310-21ssh11:14:261
18401999111,40cyclictest0-21swapper/707:21:187
18400999127,63cyclictest0-21swapper/607:26:076
18398999112,62cyclictest5787-21chk_conn_tcp09:35:354
18394999129,40cyclictest16495-21chk_conn_tcp07:11:091
18398999039,7cyclictest14262-21chk_conn_tcp08:27:334
18398999028,31cyclictest0-21swapper/412:15:534
18397999029,26cyclictest0-21swapper/307:33:353
18397999010,44cyclictest0-21swapper/309:35:033
18393999011,20cyclictest3730-21watchprog-ntop08:15:480
18401998931,36cyclictest3730-21watchprog-ntop12:32:277
18401998916,63cyclictest3730-21watchprog-ntop10:07:387
1839899898,20cyclictest0-21swapper/407:43:454
1839799898,41cyclictest0-21swapper/307:40:003
18397998943,41cyclictest0-21swapper/308:05:073
18397998923,2cyclictest4124-21nping10:02:503
18397998923,2cyclictest4124-21nping10:02:503
1839499895,62cyclictest0-21swapper/109:46:161
18394998921,66cyclictest2452-21openvpn11:51:181
18394998913,17cyclictest2904-21snmpd09:39:511
1839899886,55cyclictest3730-21watchprog-ntop09:28:384
1839499889,39cyclictest0-21swapper/112:07:521
18394998846,1cyclictest0-21swapper/107:49:051
1840199875,4cyclictest0-21swapper/709:59:057
18397998717,40cyclictest0-21swapper/310:15:393
1840099865,62cyclictest14342-21chk_conn_tcp11:36:206
18400998625,58cyclictest0-21swapper/611:08:336
18400998625,58cyclictest0-21swapper/611:08:336
18400998620,59cyclictest0-21swapper/612:31:226
18393998629,36cyclictest0-21swapper/008:35:020
18393998629,36cyclictest0-21swapper/008:35:020
18400998541,25cyclictest0-21swapper/609:34:316
18400998519,18cyclictest3730-21watchprog-ntop11:41:416
18394998529,38cyclictest16495-21chk_conn_tcp08:58:081
18393998523,40cyclictest0-21swapper/010:14:030
1839399850,19cyclictest188850irq/25-eth010:26:520
18400998422,13cyclictest0-21swapper/608:28:376
18398998446,19cyclictest16165-21chk_conn_tcp12:08:564
1839899844,41cyclictest0-21swapper/407:19:104
18398998426,35cyclictest0-21swapper/410:23:084
18398998425,36cyclictest0-21swapper/411:15:304
1839499842,44cyclictest0-21swapper/107:10:371
18401998333,40cyclictest0-21swapper/711:58:157
18400998331,51cyclictest0-21swapper/609:17:256
18400998331,51cyclictest0-21swapper/609:17:256
18397998330,42cyclictest16165-21chk_conn_tcp09:26:303
18397998322,38cyclictest0-21swapper/307:59:143
1839499837,20cyclictest16495-21chk_conn_tcp08:03:311
1839399834,44cyclictest0-21swapper/011:08:010
1839399834,44cyclictest0-21swapper/011:08:010
18393998340,1cyclictest188850irq/25-eth008:30:460
18393998323,46cyclictest188850irq/25-eth011:14:580
18397998225,5cyclictest0-21swapper/312:03:353
18393998222,20cyclictest188850irq/25-eth011:44:210
18401998122,24cyclictest0-21swapper/711:33:087
18400998119,22cyclictest0-21swapper/611:26:436
18393998169,1cyclictest3730-21watchprog-ntop10:32:450
18393998113,4cyclictest0-21swapper/009:16:210
18393998113,4cyclictest0-21swapper/009:16:210
18401998030,1cyclictest0-21swapper/707:20:147
1840199801,29cyclictest16495-21chk_conn_tcp08:07:477
18398998019,17cyclictest28715-21ssh12:29:144
18397998020,12cyclictest0-21swapper/307:09:333
18394998022,1cyclictest0-21swapper/109:28:061
18394998019,39cyclictest0-21swapper/111:42:131
18393998034,6cyclictest188850irq/25-eth010:51:590
1840199790,35cyclictest0-21swapper/711:24:357
1840199790,33cyclictest0-21swapper/710:19:247
18400997951,14cyclictest16495-21chk_conn_tcp09:13:086
18400997951,14cyclictest16495-21chk_conn_tcp09:13:086
18398997911,1cyclictest0-21swapper/412:34:034
18397997921,36cyclictest0-21swapper/311:02:413
18394997937,39cyclictest3730-21watchprog-ntop08:09:551
18394997937,21cyclictest0-21swapper/111:19:141
18394997921,0cyclictest3730-21watchprog-ntop12:35:071
18401997842,35cyclictest618-21GC07:43:157
18401997819,23cyclictest0-21swapper/707:45:537
18401997816,43cyclictest0-21swapper/711:03:457
18400997820,22cyclictest3784-21chk_conn_tcp12:20:096
1839899780,33cyclictest0-21swapper/412:22:174
18397997825,52cyclictest0-21swapper/312:34:353
18397997820,23cyclictest41-21rcuc/311:42:453
18397997813,41cyclictest0-21swapper/309:22:133
18397997813,41cyclictest0-21swapper/309:22:133
18398997713,26cyclictest22187-21kworker/4:011:41:094
18398997713,17cyclictest0-21swapper/409:00:494
18397997720,39cyclictest0-21swapper/311:53:583
1839499777,0cyclictest0-21swapper/112:11:361
68102760,1sleep76806-21chk_conn_tcp11:01:047
68102760,1sleep76806-21chk_conn_tcp11:01:047
236202760,0sleep50-21swapper/511:41:255
18401997633,29cyclictest14032-21chk_conn_tcp09:43:367
18401997633,29cyclictest14032-21chk_conn_tcp09:43:367
18401997617,25cyclictest0-21swapper/709:48:567
18398997636,39cyclictest5999-21chk_conn_tcp10:49:194
18398997636,17cyclictest0-21swapper/407:22:224
18397997628,46cyclictest0-21swapper/310:55:123
1839399763,40cyclictest0-21swapper/010:50:230
49082750,1sleep2331ktimersoftd/207:41:312
18401997518,18cyclictest0-21swapper/707:54:267
18400997521,24cyclictest13976-21chk_conn_tcp07:31:276
18398997511,43cyclictest52-21ksoftirqd/409:59:374
18396997573,1cyclictest13950irq/24-ahci[00010:04:582
18396997573,1cyclictest13950irq/24-ahci[00010:04:582
18394997538,19cyclictest0-21swapper/107:55:301
18393997514,41cyclictest0-21swapper/012:19:050
18393997511,41cyclictest3730-21watchprog-ntop09:24:210
18393997511,41cyclictest3730-21watchprog-ntop09:24:210
18400997420,36cyclictest18653-21kworker/6:108:11:326
1839999749,64cyclictest3730-21watchprog-ntop12:14:495
18398997435,14cyclictest2302-21Poller-Thread-211:36:524
18398997415,19cyclictest3730-21watchprog-ntop08:35:344
18398997415,19cyclictest3730-21watchprog-ntop08:35:344
1839799745,37cyclictest0-21swapper/312:15:213
18397997433,22cyclictest0-21swapper/308:37:103
18394997433,21cyclictest3730-21watchprog-ntop07:25:021
18393997411,27cyclictest0-21swapper/011:03:130
18401997314,22cyclictest0-21swapper/707:28:157
18400997314,39cyclictest16165-21chk_conn_tcp12:03:356
1839999730,39cyclictest0-21swapper/508:57:045
18394997322,17cyclictest0-21swapper/110:07:061
18393997323,49cyclictest0-21swapper/008:47:200
18401997232,0cyclictest14342-21chk_conn_tcp09:24:537
18401997232,0cyclictest14342-21chk_conn_tcp09:24:537
18399997233,13cyclictest0-21swapper/510:12:595
18398997223,31cyclictest0-21swapper/412:05:124
18397997226,30cyclictest3730-21watchprog-ntop07:51:133
18394997213,21cyclictest0-21swapper/109:52:411
18394997213,21cyclictest0-21swapper/109:52:411
18394997212,0cyclictest0-21swapper/108:29:091
18393997212,0cyclictest0-21swapper/011:29:560
18393997211,6cyclictest0-21swapper/007:49:370
18397997132,38cyclictest3730-21watchprog-ntop08:53:503
79862700,2sleep11839499cyclictest10:37:581
37572700,1sleep43756-21ssh10:13:584
295832700,3sleep71840199cyclictest12:29:347
1840099708,2cyclictest3730-21watchprog-ntop10:24:126
18400997016,38cyclictest15963-21chk_conn_tcp11:16:026
1839999707,40cyclictest16495-21chk_conn_tcp07:34:405
18394997051,15cyclictest16495-21chk_conn_tcp08:21:411
1839399705,41cyclictest0-21swapper/011:50:140
255262690,0sleep50-21swapper/509:36:095
18400996927,25cyclictest0-21swapper/609:04:336
18399996926,42cyclictest2262-21Poller-Thread-511:04:175
18399996913,22cyclictest0-21swapper/508:19:325
18398996932,36cyclictest16495-21chk_conn_tcp10:09:144
18398996922,1cyclictest18838-21chk_conn_tcp11:51:184
18393996933,17cyclictest3730-21watchprog-ntop11:40:050
18393996930,18cyclictest188850irq/25-eth011:23:310
220872680,0sleep60-21swapper/610:55:026
18401996830,17cyclictest4673-21chk_conn_tcp07:57:067
1839999684,57cyclictest0-21swapper/508:52:145
18399996833,20cyclictest14342-21chk_conn_tcp10:24:445
18398996837,9cyclictest0-21swapper/411:46:294
1839899683,6cyclictest52-21ksoftirqd/410:05:304
1839899683,6cyclictest52-21ksoftirqd/410:05:304
18397996827,35cyclictest3730-21watchprog-ntop10:49:193
18393996829,23cyclictest2811-21Collectd-Thread09:43:040
18393996829,23cyclictest2811-21Collectd-Thread09:43:040
322112670,1sleep532207-21chk_conn_tcp07:53:445
18400996714,23cyclictest0-21swapper/608:04:036
1839999679,7cyclictest0-21swapper/510:58:565
1839999679,7cyclictest0-21swapper/510:58:565
18399996729,27cyclictest0-21swapper/509:55:215
18399996729,27cyclictest0-21swapper/509:55:215
18398996727,30cyclictest3730-21watchprog-ntop09:47:524
1839499677,18cyclictest0-21swapper/111:06:251
1839499677,18cyclictest0-21swapper/111:06:251
40552660,1sleep559-21rcuc/511:23:065
18401996630,0cyclictest214550irq/30-eth2-TxR07:46:257
18400996630,35cyclictest4398-21diskmemload10:26:526
1840099662,9cyclictest3730-21watchprog-ntop07:23:266
18399996625,32cyclictest0-21swapper/512:26:345
18399996625,23cyclictest3730-21watchprog-ntop10:35:575
1839799667,30cyclictest0-21swapper/309:05:053
18397996623,34cyclictest0-21swapper/308:09:233
213292650,1sleep013-21rcuc/007:35:200
187552650,0sleep40-21swapper/407:33:484
18400996515,22cyclictest0-21swapper/608:20:376
18394996524,2cyclictest587-21VM07:43:151
165882650,3sleep61840099cyclictest10:41:246
97152640,0sleep60-21swapper/607:43:526
259402640,0sleep30-21swapper/308:46:313
18399996462,1cyclictest3730-21watchprog-ntop07:19:425
18399996418,45cyclictest0-21swapper/512:03:035
18399996413,33cyclictest3730-21watchprog-ntop09:30:465
1840199639,1cyclictest0-21swapper/710:54:087
18400996313,0cyclictest0-21swapper/607:58:426
1839999634,48cyclictest0-21swapper/508:48:245
18399996321,20cyclictest3730-21watchprog-ntop09:08:175
18399996321,20cyclictest3730-21watchprog-ntop09:08:175
1839899630,20cyclictest0-21swapper/408:40:234
18394996314,41cyclictest0-21swapper/110:45:351
170672630,0sleep00-21swapper/010:18:260
140092630,0sleep10-21swapper/107:46:031
28212620,0sleep20-21swapper/210:59:232
28212620,0sleep20-21swapper/210:59:232
18401996228,9cyclictest77-21rcuc/712:18:337
1840199622,13cyclictest0-21swapper/711:44:537
1840199620,13cyclictest0-21swapper/711:08:337
1840199620,13cyclictest0-21swapper/711:08:337
1840099622,38cyclictest0-21swapper/608:57:366
18400996217,3cyclictest0-21swapper/608:06:116
18399996221,0cyclictest0-21swapper/511:10:415
18399996221,0cyclictest0-21swapper/511:10:415
18397996228,0cyclictest0-21swapper/311:16:023
1839699626,32cyclictest13950irq/24-ahci[00008:59:122
18396996216,45cyclictest13950irq/24-ahci[00008:33:582
18396996216,45cyclictest13950irq/24-ahci[00008:33:582
18393996214,17cyclictest0-21swapper/009:56:570
277192610,1sleep123-21rcuc/109:59:281
18399996120,22cyclictest0-21swapper/508:33:265
18399996120,22cyclictest0-21swapper/508:33:265
18394996126,15cyclictest3730-21watchprog-ntop08:15:161
18394996115,35cyclictest0-21swapper/107:29:191
18393996123,14cyclictest0-21swapper/008:40:550
18401996032,16cyclictest0-21swapper/708:50:067
18399996025,17cyclictest0-21swapper/508:24:535
18394996039,14cyclictest3730-21watchprog-ntop09:14:121
18394996039,14cyclictest3730-21watchprog-ntop09:14:121
1839399609,15cyclictest3730-21watchprog-ntop10:44:300
58852590,0sleep50-21swapper/510:49:165
1840199595,30cyclictest3730-21watchprog-ntop08:17:247
1840199594,43cyclictest3730-21watchprog-ntop10:42:227
18401995915,5cyclictest4398-21diskmemload09:15:487
18401995915,5cyclictest4398-21diskmemload09:15:487
18401995910,3cyclictest0-21swapper/712:23:547
1839999592,31cyclictest0-21swapper/508:04:035
18398995921,19cyclictest0-21swapper/411:09:054
18398995921,19cyclictest0-21swapper/411:09:054
18398995913,1cyclictest0-21swapper/410:19:564
152882590,2sleep11839499cyclictest08:41:561
216902580,1sleep321687-21chk_conn_tcp08:16:343
18401995819,8cyclictest0-21swapper/709:51:367
18401995819,8cyclictest0-21swapper/709:51:367
1840199581,38cyclictest214550irq/30-eth2-TxR08:41:277
18400995818,0cyclictest0-21swapper/609:45:126
18400995818,0cyclictest0-21swapper/609:45:126
18400995815,27cyclictest0-21swapper/610:50:236
18399995824,0cyclictest0-21swapper/510:17:475
18399995816,35cyclictest0-21swapper/507:38:565
1839899586,7cyclictest0-21swapper/409:17:574
1839899586,7cyclictest0-21swapper/409:17:574
18398995837,1cyclictest0-21swapper/408:19:004
1839899580,57cyclictest0-21swapper/407:06:524
18394995828,27cyclictest3730-21watchprog-ntop10:25:481
18394995817,39cyclictest0-21swapper/111:34:441
18394995817,38cyclictest0-21swapper/108:46:161
106952580,1sleep60-21swapper/608:54:356
18399995719,1cyclictest0-21swapper/509:21:095
18399995719,1cyclictest0-21swapper/509:21:095
18399995714,40cyclictest14342-21chk_conn_tcp12:06:485
18397995715,38cyclictest43-21ksoftirqd/307:25:353
5562560,0sleep20-21swapper/207:54:132
1840099566,25cyclictest0-21swapper/609:11:006
1840099566,25cyclictest0-21swapper/609:11:006
18400995621,1cyclictest0-21swapper/608:35:346
18400995621,1cyclictest0-21swapper/608:35:346
18400995619,1cyclictest0-21swapper/612:13:446
18399995620,20cyclictest5045-21pool-14-thread-08:39:195
1839899567,8cyclictest15428-21DefaultUDPTrans09:44:084
1839899567,8cyclictest15428-21DefaultUDPTrans09:44:084
18393995655,0cyclictest188850irq/25-eth010:56:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional