You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 20:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7.osadl.org (updated Sun Nov 30, 2025 12:46:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2671498997231,39cyclictest0-21swapper/407:53:204
2671498997231,39cyclictest0-21swapper/407:53:204
2671498997130,39cyclictest0-21swapper/409:17:164
2671498997113,39cyclictest2747834-21ntpq09:20:194
2671498997031,18cyclictest0-21swapper/407:14:274
2671498997030,19cyclictest0-21swapper/409:39:124
2671498997011,39cyclictest2836888-21latency_hist12:00:024
2671498997011,39cyclictest2836888-21latency_hist12:00:014
2671498996929,19cyclictest0-21swapper/411:28:324
2671498996830,18cyclictest0-21swapper/410:50:154
2671498996223,19cyclictest0-21swapper/411:49:484
2671498995819,19cyclictest2738744-21gltestperf09:05:164
267149899570,38cyclictest1088-21runrttasks09:49:564
267149899550,16cyclictest0-21swapper/407:30:404
267149699550,35cyclictest0-21swapper/211:35:182
2671498995412,39cyclictest2773239-21pmu-power10:05:234
2671498995314,39cyclictest2843847-21ntpq12:10:224
2671498995313,21cyclictest0-21swapper/412:38:044
2671498995313,1cyclictest2709074-21munin-run08:15:024
2671498995312,20cyclictest1089-21snmpd12:09:354
2671498995230,19cyclictest0-21swapper/407:37:434
2671498995214,19cyclictest2723396-21systemd-run08:40:014
2671498995213,39cyclictest0-21swapper/411:02:334
2671498995213,0cyclictest2724846-21ntpq08:40:224
2671498995212,40cyclictest2711902-21munin-run08:20:014
2671498995212,21cyclictest0-21swapper/410:57:444
2671498995212,21cyclictest0-21swapper/409:41:314
2671498995212,20cyclictest0-21swapper/410:21:244
267149899519,39cyclictest2703477-21sed08:05:024
267149899519,39cyclictest2703477-21sed08:05:014
2671498995132,19cyclictest2775729-21meminfo10:10:204
2671498995112,39cyclictest0-21swapper/408:53:154
2671498995112,19cyclictest0-21swapper/411:32:084
2671498995111,39cyclictest0-21swapper/409:31:594
2671498995111,18cyclictest0-21swapper/412:25:024
267149899508,19cyclictest2812666-21ld11:15:224
2671498995031,19cyclictest0-21swapper/407:20:164
2671498995011,39cyclictest0-21swapper/412:03:004
2671498995011,39cyclictest0-21swapper/411:43:404
2671498995011,39cyclictest0-21swapper/410:45:404
2671497995013,18cyclictest0-21swapper/310:15:173
2671497995012,19cyclictest0-21swapper/308:45:173
2671496995012,19cyclictest0-21swapper/210:00:182
267149899499,40cyclictest3389514-21systemd-journal08:32:144
2671498994929,20cyclictest0-21swapper/409:10:154
2671498994911,19cyclictest2794104-21munin-run10:45:024
2671498994910,39cyclictest0-21swapper/410:03:124
2671498994910,39cyclictest0-21swapper/408:28:334
2671498994910,39cyclictest0-21swapper/408:05:184
2671498994910,39cyclictest0-21swapper/408:05:174
267149899489,39cyclictest0-21swapper/408:55:484
2671498994810,19cyclictest0-21swapper/411:21:204
2671498994810,19cyclictest0-21swapper/407:41:324
267149899478,39cyclictest0-21swapper/407:45:534
2671498994729,18cyclictest126-1kworker/4:1H+kblockd10:19:554
2671498994728,19cyclictest0-21swapper/411:09:564
267149899468,19cyclictest0-21swapper/409:58:144
267149899467,39cyclictest0-21swapper/409:01:134
267149899467,39cyclictest0-21swapper/408:45:344
267149899467,19cyclictest0-21swapper/412:15:234
267149899467,19cyclictest0-21swapper/411:51:364
2671496994627,18cyclictest0-21swapper/210:10:172
2671500994526,19cyclictest0-21swapper/610:05:196
267149899456,39cyclictest0-21swapper/410:34:344
267149899456,19cyclictest0-21swapper/407:58:044
267149899456,19cyclictest0-21swapper/407:58:034
267149799457,19cyclictest0-21swapper/311:35:183
267149899445,0cyclictest0-21swapper/407:25:224
267149899444,40cyclictest0-21swapper/411:13:234
267149799445,39cyclictest0-21swapper/310:35:183
267149899434,39cyclictest0-21swapper/412:25:424
267149899434,39cyclictest0-21swapper/411:38:014
267149899434,39cyclictest0-21swapper/410:36:584
2671498994323,20cyclictest0-21swapper/408:23:284
267149799435,19cyclictest0-21swapper/308:20:163
267149899424,19cyclictest0-21swapper/409:26:544
2671498994224,0cyclictest0-21swapper/409:50:444
267150099413,19cyclictest0-21swapper/608:10:186
267149799414,0cyclictest873-21mta-sts-daemon09:05:173
267149799413,19cyclictest0-21swapper/312:25:183
267149799400,40cyclictest0-21swapper/309:30:173
267149899390,19cyclictest0-21swapper/407:18:364
267149699390,20cyclictest0-21swapper/211:30:162
267149899380,18cyclictest0-21swapper/412:30:154
267149799380,19cyclictest0-21swapper/307:15:173
2671494993736,0cyclictest2676994-21kworker/0:2+events08:31:090
267149799360,35cyclictest0-21swapper/312:15:173
267149799360,35cyclictest0-21swapper/308:10:183
267149799360,17cyclictest0-21swapper/309:20:173
2671496993613,23cyclictest0-21swapper/209:00:172
267149499360,17cyclictest0-21swapper/008:35:170
267150199350,15cyclictest0-21swapper/710:25:167
267150099350,35cyclictest0-21swapper/611:55:186
267150099350,35cyclictest0-21swapper/611:55:186
267149799350,34cyclictest0-21swapper/310:30:183
267149799350,15cyclictest0-21swapper/307:20:223
267149699350,35cyclictest0-21swapper/211:15:182
267149699350,15cyclictest0-21swapper/207:40:192
2671494993535,0cyclictest2824816-21kworker/0:0+events11:58:020
2671494993535,0cyclictest2824816-21kworker/0:0+events11:58:010
2671494993533,1cyclictest171ktimers/010:55:220
267149499350,35cyclictest0-21swapper/011:35:230
267149499350,35cyclictest0-21swapper/011:00:160
267149499350,35cyclictest0-21swapper/008:55:180
267149499350,15cyclictest0-21swapper/012:05:180
267149499350,15cyclictest0-21swapper/011:20:180
267149499350,15cyclictest0-21swapper/007:20:220
267150099340,34cyclictest0-21swapper/609:00:176
2671497993414,19cyclictest0-21swapper/307:35:183
267149799340,15cyclictest0-21swapper/311:25:163
2671496993415,19cyclictest0-21swapper/210:30:192
267149699340,15cyclictest0-21swapper/209:35:162
267149699340,15cyclictest0-21swapper/207:10:172
2671494993414,19cyclictest0-21swapper/010:30:190
267149499340,34cyclictest0-21swapper/011:25:160
267149499340,14cyclictest0-21swapper/009:15:210
2671501993314,19cyclictest0-21swapper/708:15:187
2671497993314,19cyclictest0-21swapper/312:00:183
2671497993314,19cyclictest0-21swapper/311:30:173
2671497993314,19cyclictest0-21swapper/309:45:163
2671497993314,19cyclictest0-21swapper/309:35:153
2671497993314,19cyclictest0-21swapper/308:05:173
2671497993314,19cyclictest0-21swapper/308:05:163
2671497993313,19cyclictest0-21swapper/310:25:173
2671496993314,19cyclictest0-21swapper/211:00:172
2671496993314,19cyclictest0-21swapper/208:40:182
2671496993314,0cyclictest0-21swapper/209:20:172
2671496993313,20cyclictest0-21swapper/209:25:162
2671494993314,19cyclictest0-21swapper/012:35:180
2671494993314,19cyclictest0-21swapper/012:30:170
2671494993314,19cyclictest0-21swapper/011:40:220
2671494993314,19cyclictest0-21swapper/010:45:190
2671494993314,19cyclictest0-21swapper/009:40:150
2671494993314,19cyclictest0-21swapper/009:10:170
2671494993314,19cyclictest0-21swapper/007:35:190
2671494993314,19cyclictest0-21swapper/007:30:170
2671501993213,19cyclictest0-21swapper/711:20:247
2671501993213,19cyclictest0-21swapper/710:20:197
2671501993213,19cyclictest0-21swapper/707:25:177
2671500993214,0cyclictest0-21swapper/612:15:186
2671500993212,19cyclictest0-21swapper/609:55:186
2671497993213,19cyclictest0-21swapper/311:05:293
2671497993213,19cyclictest0-21swapper/310:45:193
2671497993213,19cyclictest0-21swapper/308:15:193
2671497993212,19cyclictest0-21swapper/312:10:173
2671496993214,18cyclictest0-21swapper/208:35:232
2671496993213,19cyclictest0-21swapper/212:00:172
2671496993213,19cyclictest0-21swapper/207:45:172
2671496993212,20cyclictest0-21swapper/212:10:182
2671494993214,0cyclictest0-21swapper/010:40:160
2671494993213,19cyclictest0-21swapper/012:10:180
2671494993213,19cyclictest0-21swapper/011:05:300
2671494993213,19cyclictest0-21swapper/010:00:190
2671494993213,19cyclictest0-21swapper/009:45:150
2671494993213,19cyclictest0-21swapper/009:00:160
2671494993213,19cyclictest0-21swapper/008:20:170
2671494993213,19cyclictest0-21swapper/007:40:180
2671494993213,19cyclictest0-21swapper/007:15:170
2671494993212,19cyclictest0-21swapper/011:45:170
2671494993212,19cyclictest0-21swapper/010:20:190
2671501993112,19cyclictest0-21swapper/707:35:187
2671501993112,19cyclictest0-21swapper/707:10:177
2671500993113,0cyclictest0-21swapper/611:10:286
2671500993112,19cyclictest0-21swapper/611:20:186
2671500993112,19cyclictest0-21swapper/608:30:166
2671500993112,19cyclictest0-21swapper/607:55:176
2671500993112,19cyclictest0-21swapper/607:55:166
2671500993111,19cyclictest0-21swapper/609:50:176
2671497993112,19cyclictest0-21swapper/307:50:293
2671497993112,19cyclictest0-21swapper/307:50:283
2671497993112,19cyclictest0-21swapper/307:45:173
2671497993112,19cyclictest0-21swapper/307:40:183
267149699317,24cyclictest0-21swapper/210:55:212
2671496993112,19cyclictest0-21swapper/209:10:182
2671496993111,19cyclictest0-21swapper/209:50:162
2671494993112,19cyclictest0-21swapper/011:50:140
2671494993112,19cyclictest0-21swapper/010:50:200
2671494993111,19cyclictest0-21swapper/009:20:170
2671500993011,19cyclictest0-21swapper/610:50:216
2671500993011,19cyclictest0-21swapper/610:10:186
2671497993011,19cyclictest0-21swapper/308:25:183
267149699307,19cyclictest0-21swapper/211:55:182
267149699307,19cyclictest0-21swapper/211:55:172
2671496993012,0cyclictest0-21swapper/208:45:162
2671496993011,19cyclictest0-21swapper/212:15:242
2671496993011,19cyclictest0-21swapper/211:10:292
2671496993011,19cyclictest0-21swapper/208:25:182
2671496993011,19cyclictest0-21swapper/208:00:172
2671496993011,19cyclictest0-21swapper/208:00:172
2671494993011,19cyclictest0-21swapper/009:55:180
2671501992910,19cyclictest0-21swapper/712:10:187
2671501992910,19cyclictest0-21swapper/710:30:197
2671501992910,19cyclictest0-21swapper/709:35:167
2671497992910,19cyclictest0-21swapper/308:30:163
2671496992910,19cyclictest0-21swapper/210:25:172
267149499299,19cyclictest0-21swapper/007:55:170
267149499299,19cyclictest0-21swapper/007:55:160
2671494992910,19cyclictest0-21swapper/012:20:150
2671494992910,19cyclictest0-21swapper/011:15:170
2671494992910,19cyclictest0-21swapper/010:25:170
267150099289,19cyclictest0-21swapper/610:30:186
267150099289,19cyclictest0-21swapper/609:20:176
267149799289,19cyclictest0-21swapper/309:10:173
2671497992810,18cyclictest0-21swapper/311:55:183
2671497992810,18cyclictest0-21swapper/311:55:183
267149499289,19cyclictest0-21swapper/010:15:150
267149499289,19cyclictest0-21swapper/007:50:290
267149499289,19cyclictest0-21swapper/007:50:280
267150099278,19cyclictest0-21swapper/610:55:226
267150099278,19cyclictest0-21swapper/608:15:196
267149799278,19cyclictest0-21swapper/308:00:173
267149799278,19cyclictest0-21swapper/308:00:163
267149599278,19cyclictest0-21swapper/112:20:161
267149599278,19cyclictest0-21swapper/112:00:181
267149599278,19cyclictest0-21swapper/111:10:281
267149599278,19cyclictest0-21swapper/109:40:151
267149599278,19cyclictest0-21swapper/108:00:171
267149599278,19cyclictest0-21swapper/108:00:161
267149599277,20cyclictest0-21swapper/111:35:171
267149599277,19cyclictest0-21swapper/109:25:161
267150199268,18cyclictest0-21swapper/711:10:277
267150199267,19cyclictest0-21swapper/707:50:297
267150199267,19cyclictest0-21swapper/707:50:297
267149799267,19cyclictest0-21swapper/309:42:243
267149699267,19cyclictest0-21swapper/207:31:592
2671496992626,0cyclictest90650irq/67-eno6-TxRx-511:51:362
267149599267,19cyclictest0-21swapper/112:10:181
267149599267,19cyclictest0-21swapper/111:50:151
267149599267,19cyclictest0-21swapper/111:45:161
267149599267,19cyclictest0-21swapper/108:40:181
267149599267,19cyclictest0-21swapper/108:05:181
267149599267,19cyclictest0-21swapper/108:05:181
267149599267,19cyclictest0-21swapper/107:45:161
267149599267,19cyclictest0-21swapper/107:20:211
267149599267,19cyclictest0-21swapper/107:15:181
267149599266,19cyclictest0-21swapper/108:25:171
267150199257,18cyclictest0-21swapper/711:50:147
267150099256,19cyclictest0-21swapper/609:10:186
267149699257,18cyclictest0-21swapper/210:45:182
267149599256,19cyclictest0-21swapper/111:55:181
267149599256,19cyclictest0-21swapper/111:55:181
267149599256,19cyclictest0-21swapper/109:15:211
267149599256,19cyclictest0-21swapper/108:30:171
267149599255,19cyclictest0-21swapper/109:20:161
267149599255,19cyclictest0-21swapper/108:55:181
267149499255,19cyclictest0-21swapper/008:15:190
267149799246,18cyclictest0-21swapper/310:10:263
267149699245,0cyclictest0-21swapper/207:19:012
267149599246,18cyclictest0-21swapper/107:35:241
267149599245,19cyclictest0-21swapper/110:40:171
267149599245,19cyclictest0-21swapper/109:55:191
267149599245,19cyclictest0-21swapper/107:25:181
267149499245,19cyclictest0-21swapper/012:00:180
2671494992420,4cyclictest2760095-21kworker/0:0+events10:12:320
2671494992419,5cyclictest2725874-21kworker/0:1+events09:05:260
267150199234,19cyclictest0-21swapper/712:05:177
2671496992319,4cyclictest1089-21snmpd08:51:482
267149599234,19cyclictest0-21swapper/111:20:171
267149599234,19cyclictest0-21swapper/109:30:161
267149599234,19cyclictest0-21swapper/107:50:291
267149599234,19cyclictest0-21swapper/107:50:291
267149599233,19cyclictest0-21swapper/111:40:221
267149599233,19cyclictest0-21swapper/109:45:171
2671494992320,3cyclictest2824816-21kworker/0:0+events12:25:580
2671494992320,3cyclictest2760095-21kworker/0:0+events10:36:400
2671494992320,3cyclictest2760095-21kworker/0:0+events10:06:430
2671494992320,3cyclictest2725874-21kworker/0:1+events09:37:470
2671494992320,3cyclictest2676994-21kworker/0:2+events08:43:110
2671494992320,3cyclictest2676994-21kworker/0:2+events08:26:320
2671494992320,3cyclictest2676994-21kworker/0:2+events08:11:480
2671494992320,3cyclictest2676994-21kworker/0:2+events07:25:430
2671494992320,3cyclictest1132272-21kworker/0:0+events07:10:340
2671494992320,2cyclictest2802369-21kworker/0:1+events11:10:240
2671494992319,4cyclictest2816289-21kworker/0:2+events11:30:300
2671494992319,4cyclictest2760095-21kworker/0:0+events09:50:300
2671494992319,4cyclictest2725874-21kworker/0:1+events09:25:250
2671494992319,4cyclictest2725874-21kworker/0:1+events08:45:260
2671494992319,4cyclictest2676994-21kworker/0:2+events08:05:260
2671494992319,4cyclictest2676994-21kworker/0:2+events08:05:250
2671494992319,4cyclictest2676994-21kworker/0:2+events07:45:540
2671494992319,3cyclictest2725874-21kworker/0:1+events09:30:380
2671494992319,3cyclictest2725874-21kworker/0:1+events08:50:090
2671494992318,4cyclictest2824816-21kworker/0:0+events12:15:060
267150099223,19cyclictest0-21swapper/610:20:176
267149799223,19cyclictest0-21swapper/308:50:173
267149699223,19cyclictest0-21swapper/207:55:172
267149699223,19cyclictest0-21swapper/207:55:162
267149699220,21cyclictest0-21swapper/211:47:382
267149599223,19cyclictest0-21swapper/111:00:161
267149599223,19cyclictest0-21swapper/110:55:221
267149599223,19cyclictest0-21swapper/108:10:181
267149599222,19cyclictest0-21swapper/112:15:171
2671494992219,2cyclictest2676994-21kworker/0:2+events08:00:180
2671494992219,2cyclictest2676994-21kworker/0:2+events08:00:180
267150099212,19cyclictest0-21swapper/609:25:156
2671500992120,1cyclictest2820666-21mii-tool11:30:176
267149799212,19cyclictest0-21swapper/311:45:173
267149699212,19cyclictest0-21swapper/210:05:192
267149699212,19cyclictest0-21swapper/208:20:162
267149599212,19cyclictest0-21swapper/109:05:171
2671495992119,1cyclictest2698772-21ethtool07:55:171
2671495992119,1cyclictest2698772-21ethtool07:55:171
2671495992119,1cyclictest1089-21snmpd10:30:571
2671495992119,1cyclictest1089-21snmpd10:00:371
2671501992019,1cyclictest2829089-21ethtool11:45:177
2671501992019,1cyclictest2727137-21ethtool08:45:177
2671501992019,1cyclictest2718440-21ethtool08:30:177
267150199200,20cyclictest0-21swapper/709:21:307
267150199200,20cyclictest0-21swapper/708:51:207
2671500992020,0cyclictest2838501-21sensors12:00:236
2671500992020,0cyclictest2755798-21mii-tool09:35:156
2671500992020,0cyclictest2681404-21ethtool07:25:176
267150099200,1cyclictest0-21swapper/611:35:536
2671499992020,0cyclictest2849019-21mii-tool12:20:165
2671499992020,0cyclictest2837788-21mii-tool12:00:175
2671499992020,0cyclictest2809464-21mii-tool11:10:295
2671499992020,0cyclictest2758642-21mii-tool09:40:165
2671499992020,0cyclictest2701620-21mii-tool08:00:175
2671499992020,0cyclictest2701620-21mii-tool08:00:175
2671499992019,1cyclictest2829108-21ethtool11:45:165
2671499992019,1cyclictest2675760-21mii-tool07:15:185
2671499992019,1cyclictest1089-21snmpd09:25:105
267149999200,20cyclictest0-21swapper/511:44:385
267149999200,20cyclictest0-21swapper/511:25:485
267149999200,20cyclictest0-21swapper/508:16:485
2671497992020,0cyclictest2781113-21mii-tool10:20:183
2671497992019,1cyclictest1089-21snmpd08:43:293
2671497992019,0cyclictest1089-21snmpd10:55:223
267149799200,20cyclictest0-21swapper/312:30:183
2671496992019,1cyclictest1089-21snmpd10:50:042
2671496992016,4cyclictest1089-21snmpd08:10:192
267149699200,20cyclictest0-21swapper/207:25:182
2671495992019,1cyclictest2778260-21mii-tool10:15:151
2671495992019,1cyclictest1089-21snmpd12:28:031
267149599201,19cyclictest0-21swapper/110:45:191
267149599200,20cyclictest0-21swapper/110:08:111
267149599200,1cyclictest0-21swapper/108:37:321
2671501991919,0cyclictest2854646-21ethtool12:30:177
2671501991919,0cyclictest2851844-21mii-tool12:25:187
2671501991919,0cyclictest2837803-21ethtool12:00:187
2671501991919,0cyclictest2823487-21mii-tool11:35:177
2671501991919,0cyclictest2817855-21ethtool11:25:167
2671501991919,0cyclictest2761445-21mii-tool09:45:177
2671501991919,0cyclictest2675779-21mii-tool07:15:187
2671501991919,0cyclictest1089-21snmpd11:33:117
2671501991919,0cyclictest1089-21snmpd09:12:187
2671501991919,0cyclictest1089-21snmpd08:38:577
2671501991918,1cyclictest2806656-21ethtool11:05:307
267150199190,19cyclictest0-21swapper/711:56:187
267150199190,19cyclictest0-21swapper/711:56:177
267150199190,19cyclictest0-21swapper/711:16:227
267150199190,19cyclictest0-21swapper/710:55:227
267150199190,19cyclictest0-21swapper/710:19:117
267150199190,19cyclictest0-21swapper/709:30:037
2671500991919,0cyclictest2803564-21mii-tool11:00:176
2671500991919,0cyclictest2715640-21mii-tool08:25:186
2671500991919,0cyclictest2712851-21ethtool08:20:166
2671500991919,0cyclictest2692920-21ethtool07:45:176
2671500991919,0cyclictest2672706-21ethtool07:10:176
2671500991919,0cyclictest1089-21snmpd07:22:516
267150099190,19cyclictest0-21swapper/612:29:486
267150099190,19cyclictest0-21swapper/612:06:006
267150099190,19cyclictest0-21swapper/610:44:486
267150099190,19cyclictest0-21swapper/610:38:006
267150099190,19cyclictest0-21swapper/610:00:116
267150099190,19cyclictest0-21swapper/609:06:336
267150099190,19cyclictest0-21swapper/608:52:276
267150099190,19cyclictest0-21swapper/607:38:166
267150099190,19cyclictest0-21swapper/607:30:096
267150099190,0cyclictest0-21swapper/608:39:006
2671499991919,0cyclictest2843388-21ethtool12:10:185
2671499991919,0cyclictest2840606-21ethtool12:05:185
2671499991919,0cyclictest2831912-21ethtool11:50:155
2671499991919,0cyclictest2823468-21mii-tool11:35:185
2671499991919,0cyclictest2724335-21ethtool08:40:185
2671499991919,0cyclictest2704423-21mii-tool08:05:185
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional