You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-15 - 21:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7.osadl.org (updated Tue Jul 15, 2025 12:46:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1782063999414,59cyclictest1923301-21kworker/u32:6+events_unbound11:55:177
1782063997517,39cyclictest1836628-21perl08:45:167
1782063997416,39cyclictest362-21jbd2/sda2-811:10:177
1782063997234,19cyclictest1900350-21/usr/sbin/munin10:40:017
178206399688,59cyclictest0-21swapper/710:34:347
1782059996039,20cyclictest1779082-21kworker/6:009:45:073
1782063995920,39cyclictest0-21swapper/709:27:437
1782063995920,19cyclictest0-21swapper/709:05:237
178206399590,20cyclictest1910551-21ntpq10:55:227
1782063995818,19cyclictest1858325-21munin-run09:25:027
178206399580,58cyclictest1924795-21ps11:20:257
1782059995719,19cyclictest1844438-21kworker/u32:3+events_unbound09:15:053
1782063995617,39cyclictest0-21swapper/708:15:487
1782063995536,18cyclictest871ktimers/708:59:407
1782063995517,19cyclictest1880137-21users10:00:267
1782063995517,19cyclictest0-21swapper/709:18:497
1782063995515,39cyclictest101750irq/39-eno2-TxRx-007:36:157
178206399550,54cyclictest0-21swapper/712:20:147
1782063995419,35cyclictest0-21swapper/708:10:157
1782063995416,19cyclictest1929513-21perl11:30:167
1782063995416,19cyclictest1852699-21munin-run09:15:027
1782063995416,19cyclictest0-21swapper/711:01:517
1782063995414,39cyclictest0-21swapper/712:10:247
1782063995414,39cyclictest0-21swapper/712:10:237
1782063995414,39cyclictest0-21swapper/708:00:517
1782063995414,39cyclictest0-21swapper/707:55:227
1782063995414,39cyclictest0-21swapper/707:55:217
1782059995436,18cyclictest0-21swapper/307:14:563
178205999540,15cyclictest0-21swapper/307:45:193
1782063995319,15cyclictest0-21swapper/709:50:077
1782063995318,15cyclictest0-21swapper/708:25:287
1782063995315,19cyclictest1907833-21ntp_states10:50:237
1782063995315,19cyclictest1814582-21ntpq08:05:247
1782063995314,39cyclictest0-21swapper/712:30:207
1782063995313,39cyclictest0-21swapper/709:55:147
1782063995233,19cyclictest0-21swapper/709:32:247
1782063995213,39cyclictest0-21swapper/712:00:187
1782063995213,39cyclictest0-21swapper/709:48:307
1782063995213,39cyclictest0-21swapper/708:50:217
1782063995213,38cyclictest0-21swapper/708:40:217
1782063995213,19cyclictest0-21swapper/711:28:387
1782059995214,19cyclictest0-21swapper/309:05:173
1782063995133,0cyclictest0-21swapper/707:45:077
1782063995132,19cyclictest0-21swapper/710:45:207
1782063995132,19cyclictest0-21swapper/707:40:167
1782063995112,39cyclictest0-21swapper/711:18:267
1782063995112,39cyclictest0-21swapper/710:18:517
1782063995112,39cyclictest0-21swapper/710:08:217
1782063995112,20cyclictest1940564-21munin-plugin-st11:50:027
1782063995111,39cyclictest0-21swapper/709:35:187
1782062995113,38cyclictest0-21swapper/610:15:216
178206399509,39cyclictest1845815-21collect209:00:247
1782063995032,18cyclictest0-21swapper/712:19:077
1782063995032,18cyclictest0-21swapper/707:12:207
1782063995013,18cyclictest0-21swapper/712:10:027
1782063995013,18cyclictest0-21swapper/712:10:017
1782063995012,38cyclictest0-21swapper/707:20:187
1782063995012,19cyclictest1806273-21ntpq07:50:347
1782063995012,19cyclictest1806273-21ntpq07:50:337
1782063995011,39cyclictest0-21swapper/711:40:237
1782063995011,39cyclictest0-21swapper/708:36:447
1782063995011,39cyclictest0-21swapper/707:28:337
1782062995011,20cyclictest0-21swapper/607:35:176
1782063994931,18cyclictest0-21swapper/712:26:117
1782063994931,18cyclictest0-21swapper/708:32:157
1782063994911,38cyclictest0-21swapper/711:35:147
1782063994911,38cyclictest0-21swapper/711:35:137
1782063994911,19cyclictest1884652-21/usr/sbin/munin10:10:187
1782062994910,19cyclictest0-21swapper/611:40:166
1782061994930,19cyclictest0-21swapper/511:50:235
178206399489,39cyclictest0-21swapper/712:39:427
178206399489,39cyclictest0-21swapper/709:41:297
178206399488,39cyclictest0-21swapper/710:40:097
178206399488,39cyclictest0-21swapper/710:27:577
1782063994829,19cyclictest0-21swapper/707:18:477
1782057994810,19cyclictest0-21swapper/110:40:191
178206399478,39cyclictest0-21swapper/711:07:027
178206399478,39cyclictest0-21swapper/708:21:537
178206399477,39cyclictest0-21swapper/710:22:547
178205899479,19cyclictest0-21swapper/212:10:212
178205899479,19cyclictest0-21swapper/212:10:202
178206399467,39cyclictest0-21swapper/711:53:217
178206399467,39cyclictest0-21swapper/707:31:187
178206199457,19cyclictest0-21swapper/511:15:155
178205699457,19cyclictest0-21swapper/011:25:180
1782057994426,18cyclictest0-21swapper/108:40:171
1782060994325,18cyclictest0-21swapper/409:50:154
1782062994223,19cyclictest0-21swapper/611:25:186
178206099424,19cyclictest0-21swapper/409:55:184
178205799413,19cyclictest0-21swapper/112:15:171
1782059994019,20cyclictest1900585-21kworker/u32:0+events_unbound11:15:123
178206299391,19cyclictest771rcuc/611:05:176
178206299391,19cyclictest0-21swapper/608:00:176
178206199390,20cyclictest0-21swapper/512:35:155
178205699390,19cyclictest0-21swapper/009:10:160
178206099380,19cyclictest0-21swapper/408:10:164
178205899380,38cyclictest0-21swapper/210:05:182
178205799380,19cyclictest0-21swapper/107:55:191
178205799380,19cyclictest0-21swapper/107:55:181
178205699380,38cyclictest0-21swapper/007:15:200
1782062993719,18cyclictest0-21swapper/609:35:216
178206099370,18cyclictest0-21swapper/409:05:174
178205799360,36cyclictest0-21swapper/107:45:181
178206299350,15cyclictest0-21swapper/607:30:166
178206199350,35cyclictest0-21swapper/511:55:185
178206199350,16cyclictest0-21swapper/512:20:165
178206199350,15cyclictest0-21swapper/511:00:175
178206199350,15cyclictest0-21swapper/510:10:175
178205999350,35cyclictest0-21swapper/311:35:183
178205999350,35cyclictest0-21swapper/311:35:173
178205899350,15cyclictest0-21swapper/209:00:202
178205699350,15cyclictest0-21swapper/007:45:190
178206299340,15cyclictest0-21swapper/612:30:176
178206299340,14cyclictest0-21swapper/609:15:186
178206199340,34cyclictest0-21swapper/511:30:165
1782059993415,19cyclictest0-21swapper/310:10:183
1782059993415,19cyclictest0-21swapper/309:57:073
178205999340,34cyclictest0-21swapper/312:05:163
178205999340,34cyclictest0-21swapper/312:05:153
178205999340,34cyclictest0-21swapper/308:15:173
178205799340,15cyclictest0-21swapper/112:05:161
178205799340,15cyclictest0-21swapper/112:05:151
178205799340,15cyclictest0-21swapper/108:35:261
1782056993415,19cyclictest0-21swapper/012:35:160
1782056993415,19cyclictest0-21swapper/010:55:180
1782056993414,19cyclictest0-21swapper/012:15:170
178205699340,34cyclictest0-21swapper/012:00:160
178205699340,34cyclictest0-21swapper/008:10:160
1782063993313,19cyclictest0-21swapper/707:10:027
1782062993314,19cyclictest0-21swapper/609:55:176
1782062993314,19cyclictest0-21swapper/609:20:156
1782062993314,19cyclictest0-21swapper/609:10:156
1782062993314,19cyclictest0-21swapper/608:20:196
1782062993314,19cyclictest0-21swapper/608:05:206
178206299330,14cyclictest0-21swapper/608:10:186
1782061993314,19cyclictest0-21swapper/511:40:175
1782061993314,19cyclictest0-21swapper/511:20:205
1782061993314,19cyclictest0-21swapper/510:30:165
1782061993314,19cyclictest0-21swapper/510:05:185
1782061993314,19cyclictest0-21swapper/509:35:205
1782061993314,19cyclictest0-21swapper/508:45:175
1782061993314,19cyclictest0-21swapper/508:00:185
1782060993314,19cyclictest0-21swapper/412:25:174
1782059993314,19cyclictest0-21swapper/311:45:143
1782059993314,19cyclictest0-21swapper/311:27:133
1782059993314,19cyclictest0-21swapper/311:21:143
1782059993314,19cyclictest0-21swapper/311:00:163
1782059993314,19cyclictest0-21swapper/310:00:183
1782059993314,19cyclictest0-21swapper/309:50:163
1782059993314,19cyclictest0-21swapper/308:21:013
1782059993314,19cyclictest0-21swapper/307:26:563
1782059993314,0cyclictest0-21swapper/312:03:173
1782059993314,0cyclictest0-21swapper/309:39:063
1782059993313,19cyclictest0-21swapper/310:55:183
1782058993315,18cyclictest0-21swapper/209:05:182
1782058993314,19cyclictest0-21swapper/210:15:212
1782058993314,19cyclictest0-21swapper/210:00:182
1782058993314,19cyclictest0-21swapper/207:50:272
1782058993314,19cyclictest0-21swapper/207:50:262
1782058993314,19cyclictest0-21swapper/207:10:192
1782057993314,19cyclictest0-21swapper/109:30:161
1782057993314,19cyclictest0-21swapper/109:05:181
1782056993314,19cyclictest0-21swapper/011:30:170
1782056993314,19cyclictest0-21swapper/011:10:170
1782056993314,19cyclictest0-21swapper/010:45:200
1782056993314,19cyclictest0-21swapper/010:40:180
1782056993314,19cyclictest0-21swapper/010:20:180
1782056993314,19cyclictest0-21swapper/009:30:150
1782056993314,19cyclictest0-21swapper/008:45:160
1782056993314,19cyclictest0-21swapper/008:40:180
1782056993314,19cyclictest0-21swapper/007:40:150
1782056993314,0cyclictest0-21swapper/009:00:200
178205699330,33cyclictest0-21swapper/010:50:180
1782062993214,18cyclictest0-21swapper/610:25:186
1782062993213,19cyclictest0-21swapper/609:40:166
1782062993213,19cyclictest0-21swapper/609:00:206
1782062993213,19cyclictest0-21swapper/608:55:176
1782062993213,19cyclictest0-21swapper/608:35:246
1782062993213,19cyclictest0-21swapper/608:15:166
1782062993213,19cyclictest0-21swapper/607:50:276
1782062993213,19cyclictest0-21swapper/607:50:266
1782062993213,19cyclictest0-21swapper/607:25:186
1782062993213,19cyclictest0-21swapper/607:10:196
1782061993213,19cyclictest0-21swapper/511:10:185
1782061993213,19cyclictest0-21swapper/510:40:195
1782061993213,19cyclictest0-21swapper/508:55:175
1782061993213,19cyclictest0-21swapper/507:30:165
1782060993213,19cyclictest0-21swapper/410:55:194
1782059993214,0cyclictest0-21swapper/310:09:083
1782059993213,19cyclictest0-21swapper/312:33:183
1782059993213,19cyclictest0-21swapper/311:51:163
1782059993213,19cyclictest0-21swapper/310:39:113
1782059993213,19cyclictest0-21swapper/310:21:083
1782059993213,19cyclictest0-21swapper/310:15:203
1782059993213,19cyclictest0-21swapper/308:30:173
1782059993213,19cyclictest0-21swapper/307:50:273
1782059993213,19cyclictest0-21swapper/307:50:263
1782059993213,19cyclictest0-21swapper/307:20:183
1782059993213,0cyclictest0-21swapper/312:39:203
1782058993213,19cyclictest0-21swapper/212:20:162
1782058993213,19cyclictest0-21swapper/208:50:172
1782057993213,19cyclictest876-21mta-sts-daemon10:45:191
1782057993213,19cyclictest0-21swapper/110:35:181
1782057993212,20cyclictest0-21swapper/112:35:151
1782056993213,19cyclictest0-21swapper/011:20:200
1782056993213,19cyclictest0-21swapper/011:00:160
1782056993213,19cyclictest0-21swapper/009:25:180
1782056993213,19cyclictest0-21swapper/008:20:180
1782062993112,19cyclictest0-21swapper/612:10:206
1782062993112,19cyclictest0-21swapper/612:10:206
1782062993112,19cyclictest0-21swapper/609:45:186
1782061993112,19cyclictest0-21swapper/510:20:175
1782061993112,19cyclictest0-21swapper/509:20:155
1782061993112,19cyclictest0-21swapper/507:40:165
1782061993112,19cyclictest0-21swapper/507:10:175
1782060993112,19cyclictest0-21swapper/410:40:194
1782059993113,0cyclictest0-21swapper/308:09:003
1782059993113,0cyclictest0-21swapper/307:38:583
1782059993112,19cyclictest0-21swapper/311:30:173
1782059993112,19cyclictest0-21swapper/309:25:173
1782059993112,19cyclictest0-21swapper/308:55:173
1782059993112,19cyclictest0-21swapper/308:39:013
1782058993112,19cyclictest0-21swapper/208:00:182
1782058993112,19cyclictest0-21swapper/207:35:172
1782057993113,18cyclictest0-21swapper/111:50:221
1782057993112,19cyclictest0-21swapper/111:25:191
1782057993112,19cyclictest0-21swapper/109:00:191
1782057993112,19cyclictest0-21swapper/108:30:161
1782057993112,19cyclictest0-21swapper/107:25:191
1782057993112,19cyclictest0-21swapper/107:20:171
1782062993011,19cyclictest0-21swapper/608:50:176
1782062993011,19cyclictest0-21swapper/608:40:186
1782062993011,19cyclictest0-21swapper/607:40:156
178206199306,19cyclictest0-21swapper/512:15:185
1782061993011,19cyclictest0-21swapper/511:35:185
1782061993011,19cyclictest0-21swapper/511:35:175
1782061993011,19cyclictest0-21swapper/510:25:185
1782061993011,19cyclictest0-21swapper/508:35:255
1782060993012,0cyclictest0-21swapper/411:45:144
1782059993012,18cyclictest0-21swapper/312:27:193
1782058993011,19cyclictest0-21swapper/208:30:172
1782057993011,19cyclictest0-21swapper/111:30:231
1782057993011,19cyclictest0-21swapper/110:25:171
1782056993011,19cyclictest0-21swapper/012:25:180
1782056993011,19cyclictest0-21swapper/011:55:170
1782056993011,19cyclictest0-21swapper/009:05:170
1782056993011,19cyclictest0-21swapper/007:10:170
1782062992911,18cyclictest0-21swapper/610:05:176
1782061992910,19cyclictest0-21swapper/509:55:175
1782061992910,19cyclictest0-21swapper/507:50:265
1782061992910,19cyclictest0-21swapper/507:50:265
1782059992911,0cyclictest0-21swapper/307:44:573
1782059992910,19cyclictest0-21swapper/311:05:183
1782059992910,19cyclictest0-21swapper/308:00:173
1782058992911,18cyclictest0-21swapper/211:50:232
1782058992910,19cyclictest0-21swapper/212:25:182
1782058992910,19cyclictest0-21swapper/210:50:192
1782058992910,19cyclictest0-21swapper/208:20:192
1782058992910,19cyclictest0-21swapper/207:55:182
1782058992910,19cyclictest0-21swapper/207:55:182
1782057992910,0cyclictest0-21swapper/111:20:191
1782056992910,19cyclictest0-21swapper/009:50:150
178205999289,19cyclictest0-21swapper/307:30:173
178205899289,19cyclictest0-21swapper/210:35:192
1782058992810,18cyclictest0-21swapper/209:50:162
178205799289,19cyclictest0-21swapper/107:10:171
178205699289,19cyclictest0-21swapper/011:40:160
178205699289,19cyclictest0-21swapper/008:15:170
178205699289,0cyclictest0-21swapper/010:30:160
178206199278,19cyclictest0-21swapper/512:30:185
178206199278,19cyclictest0-21swapper/510:45:195
178206199278,19cyclictest0-21swapper/508:10:245
178206199278,0cyclictest0-21swapper/509:25:165
178206099278,19cyclictest0-21swapper/410:35:184
178205999278,19cyclictest0-21swapper/311:40:163
178205799278,19cyclictest0-21swapper/108:47:081
178205799278,0cyclictest0-21swapper/108:26:481
178205699278,19cyclictest0-21swapper/012:30:170
178205699277,19cyclictest0-21swapper/007:25:180
178206299267,19cyclictest0-21swapper/608:25:266
178206199267,19cyclictest0-21swapper/507:20:175
178206099267,19cyclictest0-21swapper/410:25:174
178205799267,19cyclictest0-21swapper/107:15:201
178206199256,19cyclictest0-21swapper/509:30:165
178205999256,19cyclictest0-21swapper/311:10:183
178205799256,19cyclictest0-21swapper/107:35:161
178206299246,18cyclictest0-21swapper/610:30:166
178206199245,19cyclictest0-21swapper/507:25:205
178206199245,0cyclictest0-21swapper/512:26:465
1782060992424,0cyclictest0-21swapper/412:03:454
1782059992420,4cyclictest1773348-21kworker/3:1+events07:19:313
178205899245,19cyclictest0-21swapper/210:42:272
178205699245,19cyclictest0-21swapper/008:55:170
178206199234,0cyclictest0-21swapper/510:00:175
1782061992319,4cyclictest1898647-21mii-tool10:35:185
1782061992318,5cyclictest1834094-21mii-tool08:40:185
178206199230,21cyclictest1821747-21apt-get08:20:145
1782059992320,3cyclictest1883407-21kworker/3:2+events10:31:153
1782059992320,3cyclictest1796110-21kworker/3:0+events08:40:403
178205899234,19cyclictest0-21swapper/210:55:182
178205899230,23cyclictest0-21swapper/207:25:162
178205799234,19cyclictest0-21swapper/109:10:161
178205699234,19cyclictest0-21swapper/012:20:160
178206299223,19cyclictest0-21swapper/609:50:166
1782061992219,3cyclictest1926983-21mii-tool11:25:185
178205899223,19cyclictest0-21swapper/208:55:232
178205899220,22cyclictest0-21swapper/210:30:312
178205899220,1cyclictest0-21swapper/211:10:232
178205799223,19cyclictest0-21swapper/109:20:161
178205699223,19cyclictest0-21swapper/010:10:240
1782060992121,0cyclictest0-21swapper/412:14:344
1782060992121,0cyclictest0-21swapper/412:14:334
178205999212,19cyclictest1955728-21/usr/sbin/munin12:15:183
1782059992120,1cyclictest1883407-21kworker/3:2+events10:45:223
1782059992120,1cyclictest1796110-21kworker/3:0+events09:35:013
1782059992120,1cyclictest1796110-21kworker/3:0+events09:10:143
1782059992120,1cyclictest1089-21snmpd07:59:053
1782059992120,1cyclictest1089-21snmpd07:59:043
1782059992119,2cyclictest1883407-21kworker/3:2+events10:44:433
1782059992118,3cyclictest1883407-21kworker/3:2+events12:20:393
178205899212,19cyclictest0-21swapper/212:00:152
178205899212,19cyclictest0-21swapper/209:30:162
178205899210,0cyclictest0-21swapper/210:26:522
178205899210,0cyclictest0-21swapper/209:55:152
178205699212,19cyclictest0-21swapper/008:05:210
178206299200,20cyclictest0-21swapper/612:36:296
178206199200,4cyclictest0-21swapper/510:55:135
178206199200,20cyclictest0-21swapper/512:10:015
178206199200,20cyclictest0-21swapper/512:10:005
178206199200,20cyclictest0-21swapper/512:04:195
178206199200,20cyclictest0-21swapper/511:06:475
178206199200,20cyclictest0-21swapper/509:15:225
178206199200,20cyclictest0-21swapper/508:31:275
178206199200,20cyclictest0-21swapper/508:06:175
178206199200,20cyclictest0-21swapper/507:59:245
178206199200,20cyclictest0-21swapper/507:59:235
178206199200,0cyclictest0-21swapper/511:45:155
1782060992019,1cyclictest1929776-21cat11:30:164
1782060992019,1cyclictest1802958-21mii-tool07:45:184
1782060992019,1cyclictest1786090-21mii-tool07:15:204
1782060992019,1cyclictest1089-21snmpd08:50:184
178206099200,20cyclictest0-21swapper/409:43:074
178206099200,20cyclictest0-21swapper/409:16:164
178206099200,20cyclictest0-21swapper/409:04:304
178206099200,20cyclictest0-21swapper/408:00:494
1782059992020,0cyclictest1883407-21kworker/3:2+events12:11:103
1782059992020,0cyclictest1883407-21kworker/3:2+events12:11:093
1782059992020,0cyclictest1883407-21kworker/3:2+events11:55:173
1782059992020,0cyclictest1796110-21kworker/3:0+events09:20:373
1782059992020,0cyclictest1796110-21kworker/3:0+events09:00:303
1782059992020,0cyclictest1796110-21kworker/3:0+events08:50:183
1782059992020,0cyclictest1796110-21kworker/3:0+events08:45:093
1782059992020,0cyclictest1796110-21kworker/3:0+events08:10:273
1782059992019,1cyclictest1883407-21kworker/3:2+events10:50:013
1782059992019,1cyclictest1883407-21kworker/3:2+events10:25:303
1782059992019,1cyclictest1796110-21kworker/3:0+events09:40:213
1782059992019,1cyclictest1796110-21kworker/3:0+events08:25:173
1782058992020,0cyclictest1935908-21mii-tool11:40:172
1782058992020,0cyclictest1089-21snmpd11:16:402
1782058992020,0cyclictest0-21swapper/208:07:152
1782058992019,1cyclictest1089-21snmpd09:41:172
1782058992019,1cyclictest0-21swapper/211:58:032
1782058992019,1cyclictest0-21swapper/208:17:352
1782058992019,1cyclictest0-21swapper/207:18:402
178205899200,20cyclictest0-21swapper/210:45:572
178205899200,20cyclictest0-21swapper/209:20:232
178205899200,20cyclictest0-21swapper/207:46:352
178205899200,20cyclictest0-21swapper/207:21:062
178205899200,1cyclictest0-21swapper/211:00:352
178205899200,1cyclictest0-21swapper/208:28:292
1782057992020,0cyclictest1935927-21mii-tool11:40:161
1782057992019,1cyclictest1089-21snmpd08:55:551
178205799200,20cyclictest0-21swapper/108:15:171
178205799200,1cyclictest0-21swapper/111:39:031
178205799200,1cyclictest0-21swapper/111:39:031
178205799200,1cyclictest0-21swapper/110:08:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional