You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-07 - 03:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7.osadl.org (updated Tue Jul 07, 2026 00:46:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
929844999315,59cyclictest948529-21irqstats19:45:152
929844999114,58cyclictest1047224-21grep22:45:012
929844998666,0cyclictest1085177-21sed23:50:232
929844997639,18cyclictest421ktimers/200:37:432
929848997354,19cyclictest0-21swapper/622:55:206
929844997052,0cyclictest0-21swapper/220:10:112
929844997031,19cyclictest1101425-21python300:20:212
92984499697,39cyclictest1010486-21tr21:35:252
92984499697,39cyclictest1010486-21tr21:35:252
92984499686,40cyclictest1091175-21sshd00:03:352
929844996527,38cyclictest0-21swapper/222:50:152
92984499646,39cyclictest972720-21apt-get20:30:112
92984499646,39cyclictest947299-21/usr/sbin/munin19:45:012
92984499636,38cyclictest1028124-21unin-run22:10:012
92984499634,39cyclictest958602-21awk20:05:012
929844996326,18cyclictest0-21swapper/221:00:152
929844996223,38cyclictest0-21swapper/219:35:032
929844996222,39cyclictest0-21swapper/221:41:272
929844996217,40cyclictest1091816-21telnet00:05:132
929844996122,39cyclictest0-21swapper/222:18:592
929844996122,39cyclictest0-21swapper/222:18:592
929844996122,39cyclictest0-21swapper/220:35:232
929844996022,38cyclictest0-21swapper/220:09:112
929844996021,39cyclictest0-21swapper/222:58:272
92984499601,40cyclictest1071707-21taskset23:28:232
92984799590,1cyclictest0-21swapper/500:00:255
929844995919,39cyclictest0-21swapper/223:11:312
929844995919,39cyclictest0-21swapper/221:11:592
929844995919,39cyclictest0-21swapper/219:28:432
92984499590,58cyclictest0-21swapper/223:45:552
929844995820,38cyclictest0-21swapper/222:01:192
929844995819,39cyclictest0-21swapper/223:17:312
929844995819,39cyclictest0-21swapper/223:09:142
929844995819,39cyclictest0-21swapper/222:47:472
929844995819,39cyclictest0-21swapper/222:39:072
929844995819,39cyclictest0-21swapper/222:23:592
929844995819,39cyclictest0-21swapper/220:55:512
929844995819,39cyclictest0-21swapper/220:15:392
929844995819,39cyclictest0-21swapper/219:23:072
929844995819,39cyclictest0-21swapper/200:16:272
929844995819,39cyclictest0-21swapper/200:13:152
929844995819,38cyclictest0-21swapper/223:44:472
929844995818,39cyclictest0-21swapper/223:01:312
929844995818,39cyclictest0-21swapper/221:30:592
929844995818,39cyclictest0-21swapper/221:22:552
929844995818,39cyclictest0-21swapper/220:27:592
929844995818,39cyclictest0-21swapper/219:18:392
92983499580,58cyclictest0-21swapper/021:50:160
929844995739,0cyclictest0-21swapper/221:18:272
929844995719,38cyclictest101850irq/42-eno2-TxRx-300:32:552
929844995719,38cyclictest0-21swapper/221:49:232
929844995718,39cyclictest0-21swapper/221:54:072
929844995718,39cyclictest0-21swapper/220:47:232
929844995718,39cyclictest0-21swapper/220:20:312
929844995718,39cyclictest0-21swapper/219:51:432
929844995718,39cyclictest0-21swapper/200:27:422
929844995718,38cyclictest0-21swapper/219:56:262
929844995718,19cyclictest0-21swapper/223:55:072
929844995638,18cyclictest101850irq/42-eno2-TxRx-319:30:472
929844995638,18cyclictest0-21swapper/221:59:392
929844995633,20cyclictest0-21swapper/223:38:092
929844995618,38cyclictest101850irq/42-eno2-TxRx-322:27:232
929844995618,38cyclictest101850irq/42-eno2-TxRx-322:27:232
929844995617,39cyclictest0-21swapper/219:10:352
929844995516,39cyclictest0-21swapper/223:31:432
929844995516,20cyclictest1003036-21/usr/sbin/munin21:25:132
929844995515,39cyclictest101850irq/42-eno2-TxRx-322:14:222
929848995416,19cyclictest0-21swapper/622:30:176
929848995416,19cyclictest0-21swapper/622:30:176
929844995434,19cyclictest0-21swapper/222:30:152
929844995434,19cyclictest0-21swapper/222:30:152
929844995431,19cyclictest984938-21ntp_offset20:50:212
929844995414,39cyclictest0-21swapper/220:44:442
929844995314,39cyclictest0-21swapper/221:09:192
929849995214,19cyclictest0-21swapper/721:10:177
929848995214,19cyclictest0-21swapper/619:15:146
929846995214,19cyclictest0-21swapper/421:50:164
929840995214,19cyclictest0-21swapper/100:25:171
929848995012,38cyclictest0-21swapper/623:35:166
929845995012,19cyclictest0-21swapper/300:25:173
929840995012,19cyclictest0-21swapper/122:30:171
929840995012,19cyclictest0-21swapper/122:30:171
929848994911,20cyclictest0-21swapper/620:40:166
92984499489,39cyclictest0-21swapper/223:21:232
92984899479,19cyclictest0-21swapper/619:55:176
92983499479,19cyclictest0-21swapper/023:10:160
92984899468,19cyclictest0-21swapper/621:10:176
92983499468,19cyclictest0-21swapper/023:25:170
92983499468,19cyclictest0-21swapper/022:30:170
92983499468,19cyclictest0-21swapper/022:30:170
92984099457,19cyclictest0-21swapper/100:10:161
92984099446,19cyclictest0-21swapper/122:15:161
92984099446,19cyclictest0-21swapper/122:15:161
92984599424,19cyclictest0-21swapper/320:40:163
92984599423,19cyclictest0-21swapper/321:55:173
92984099424,19cyclictest0-21swapper/120:40:161
929834994224,18cyclictest0-21swapper/021:45:160
92983499420,19cyclictest0-21swapper/019:50:150
929849994040,0cyclictest0-21swapper/720:30:137
929845994021,0cyclictest0-21swapper/320:25:163
92984099402,19cyclictest0-21swapper/122:50:161
929834994038,1cyclictest0-21swapper/021:23:240
929834994021,19cyclictest0-21swapper/019:40:160
92984599391,19cyclictest0-21swapper/320:30:153
92984799380,38cyclictest0-21swapper/520:50:175
92984599380,38cyclictest0-21swapper/300:00:133
92984599380,19cyclictest0-21swapper/319:55:173
929840993838,0cyclictest0-21swapper/121:25:491
92983499380,19cyclictest0-21swapper/023:05:160
92984799370,18cyclictest681rcuc/522:25:175
92984799370,18cyclictest681rcuc/522:25:175
92984699370,18cyclictest0-21swapper/420:10:144
929845993737,0cyclictest0-21swapper/322:45:013
929840993737,0cyclictest0-21swapper/121:00:011
92984999360,17cyclictest0-21swapper/720:00:167
929845993616,19cyclictest0-21swapper/323:15:173
92984599360,17cyclictest0-21swapper/321:45:163
929840993636,0cyclictest0-21swapper/121:36:491
929840993636,0cyclictest0-21swapper/121:36:491
92984099360,17cyclictest0-21swapper/120:00:161
92983499360,35cyclictest0-21swapper/021:10:170
92983499360,17cyclictest0-21swapper/019:35:160
929849993535,0cyclictest0-21swapper/721:00:017
92984999350,15cyclictest0-21swapper/719:55:177
929848993516,0cyclictest79-21ksoftirqd/621:40:156
92984799350,35cyclictest0-21swapper/521:35:195
92984799350,35cyclictest0-21swapper/521:35:185
92984799350,16cyclictest0-21swapper/522:10:015
92984699350,35cyclictest0-21swapper/420:30:154
92984699350,15cyclictest0-21swapper/421:25:144
92984599350,35cyclictest0-21swapper/321:10:163
92984599350,16cyclictest0-21swapper/319:30:163
92984599350,15cyclictest0-21swapper/323:20:173
929840993534,0cyclictest0-21swapper/121:23:251
929834993517,18cyclictest31750irq/70-ice-0000:f4:00.0:misc22:10:140
92983499350,34cyclictest0-21swapper/021:15:050
92983499350,15cyclictest0-21swapper/022:55:200
929849993434,0cyclictest0-21swapper/721:29:137
92984999340,33cyclictest0-21swapper/721:35:017
92984899340,34cyclictest0-21swapper/623:45:156
92984899340,15cyclictest0-21swapper/623:00:166
92984799340,34cyclictest0-21swapper/523:05:165
92984699340,15cyclictest0-21swapper/420:05:164
929845993414,19cyclictest0-21swapper/322:45:163
929845993414,19cyclictest0-21swapper/300:05:163
92984599340,15cyclictest0-21swapper/320:00:163
929840993434,0cyclictest0-21swapper/119:23:491
929840993434,0cyclictest0-21swapper/119:16:411
929840993414,20cyclictest0-21swapper/100:20:151
92984099340,34cyclictest0-21swapper/122:10:201
92984099340,34cyclictest0-21swapper/100:15:161
92984099340,15cyclictest0-21swapper/120:50:171
92984099340,15cyclictest0-21swapper/119:35:151
929834993433,1cyclictest0-21swapper/022:27:370
929834993433,1cyclictest0-21swapper/022:27:370
929834993413,20cyclictest0-21swapper/000:15:160
92983499340,15cyclictest0-21swapper/023:55:160
929849993314,19cyclictest0-21swapper/720:35:177
929848993333,0cyclictest925013-21kworker/6:2+events19:40:176
929848993314,19cyclictest0-21swapper/620:50:176
929848993314,19cyclictest0-21swapper/600:10:166
929847993314,19cyclictest0-21swapper/520:15:155
929846993314,19cyclictest0-21swapper/421:55:174
929846993314,19cyclictest0-21swapper/421:45:164
929846993314,19cyclictest0-21swapper/419:50:164
929846993314,19cyclictest0-21swapper/419:40:164
929845993314,19cyclictest0-21swapper/323:30:163
929845993314,19cyclictest0-21swapper/323:00:163
929845993314,19cyclictest0-21swapper/322:55:203
929845993314,19cyclictest0-21swapper/321:05:163
929845993314,19cyclictest0-21swapper/320:55:173
929845993314,19cyclictest0-21swapper/320:35:173
929845993314,19cyclictest0-21swapper/320:15:153
929845993314,19cyclictest0-21swapper/319:20:183
929845993312,20cyclictest0-21swapper/319:45:143
929840993314,19cyclictest0-21swapper/123:35:161
929840993314,19cyclictest0-21swapper/123:15:171
929840993314,19cyclictest0-21swapper/123:05:161
929840993314,19cyclictest0-21swapper/122:35:151
929840993314,19cyclictest0-21swapper/121:15:151
929840993314,19cyclictest0-21swapper/121:00:161
929840993314,0cyclictest0-21swapper/123:50:161
929840993313,20cyclictest0-21swapper/119:45:141
929840993313,1cyclictest0-21swapper/123:00:161
929840993312,20cyclictest0-21swapper/122:20:141
929834993314,19cyclictest0-21swapper/021:05:160
929834993314,19cyclictest0-21swapper/020:04:400
92983499330,14cyclictest0-21swapper/019:25:170
929849993231,1cyclictest30750irq/60-ahci[0000:00:07.0]21:15:057
929849993213,19cyclictest0-21swapper/722:45:167
929848993232,0cyclictest925013-21kworker/6:2+events20:30:216
929848993213,19cyclictest0-21swapper/623:20:176
929848993213,19cyclictest0-21swapper/621:55:176
929848993213,19cyclictest0-21swapper/620:35:166
929848993213,19cyclictest0-21swapper/600:15:166
929848993213,19cyclictest0-21swapper/600:00:136
929846993213,19cyclictest0-21swapper/422:55:204
929846993213,19cyclictest0-21swapper/419:45:144
929845993213,19cyclictest0-21swapper/320:20:243
929845993213,19cyclictest0-21swapper/320:05:163
929840993213,19cyclictest0-21swapper/123:45:151
929840993213,19cyclictest0-21swapper/121:30:171
929840993213,19cyclictest0-21swapper/119:30:161
929840993213,19cyclictest0-21swapper/100:00:141
929840993213,0cyclictest0-21swapper/123:20:171
929834993213,19cyclictest0-21swapper/023:40:150
929834993213,19cyclictest0-21swapper/023:00:150
929834993213,19cyclictest0-21swapper/022:05:150
929834993213,19cyclictest0-21swapper/020:45:170
929849993131,0cyclictest0-21swapper/721:23:257
929849993112,19cyclictest0-21swapper/723:45:157
929849993112,19cyclictest0-21swapper/723:20:177
929849993112,19cyclictest0-21swapper/719:20:187
929848993131,0cyclictest925013-21kworker/6:2+events21:00:206
929848993112,19cyclictest0-21swapper/622:35:156
929848993112,19cyclictest0-21swapper/621:15:156
929848993111,20cyclictest0-21swapper/620:20:186
929847993112,19cyclictest0-21swapper/522:00:165
929846993112,19cyclictest0-21swapper/421:20:174
929846993112,19cyclictest0-21swapper/420:45:164
929845993113,18cyclictest0-21swapper/319:50:163
929845993112,19cyclictest0-21swapper/323:50:163
929845993112,19cyclictest0-21swapper/323:45:153
929845993112,19cyclictest0-21swapper/321:30:183
929845993112,19cyclictest0-21swapper/319:40:153
929840993112,19cyclictest0-21swapper/122:00:151
929840993112,19cyclictest0-21swapper/120:20:171
929840993112,19cyclictest0-21swapper/100:05:151
929840993111,19cyclictest0-21swapper/122:25:171
929840993111,19cyclictest0-21swapper/122:25:161
92983499318,19cyclictest0-21swapper/000:30:170
929834993113,18cyclictest0-21swapper/021:00:160
929834993112,19cyclictest0-21swapper/021:25:140
929834993112,19cyclictest0-21swapper/019:34:360
929849993011,19cyclictest0-21swapper/722:55:107
929848993011,19cyclictest0-21swapper/622:15:166
929848993011,19cyclictest0-21swapper/622:15:166
929848993011,19cyclictest0-21swapper/620:10:156
929846993012,18cyclictest0-21swapper/421:05:164
929846993012,18cyclictest0-21swapper/400:30:164
929846993011,19cyclictest0-21swapper/423:25:184
929846993011,19cyclictest0-21swapper/419:25:174
929845993012,18cyclictest0-21swapper/300:15:223
929840993012,18cyclictest0-21swapper/121:05:161
929834993030,0cyclictest89550irq/48-eno5-TxRx-420:19:530
929834993012,18cyclictest0-21swapper/020:30:150
929849992910,19cyclictest0-21swapper/700:20:147
929848992929,0cyclictest925013-21kworker/6:2+events21:40:016
929848992929,0cyclictest925013-21kworker/6:2+events21:40:016
929847992910,19cyclictest0-21swapper/522:50:165
929847992910,19cyclictest0-21swapper/521:15:145
929846992910,19cyclictest0-21swapper/423:40:154
929845992911,18cyclictest0-21swapper/300:20:143
929845992910,19cyclictest0-21swapper/321:00:163
929845992910,19cyclictest0-21swapper/319:35:163
92984099299,19cyclictest0-21swapper/122:40:161
929840992911,18cyclictest0-21swapper/120:25:171
929834992928,0cyclictest935936-21kworker/0:2+ice21:36:410
929834992928,0cyclictest935936-21kworker/0:2+ice21:36:410
92984999289,19cyclictest0-21swapper/722:40:167
92984999289,19cyclictest0-21swapper/720:05:167
92984899289,19cyclictest0-21swapper/619:30:166
929848992828,0cyclictest1041935-21kworker/6:1+events00:35:016
92984799289,19cyclictest0-21swapper/523:55:235
92984799289,19cyclictest0-21swapper/500:10:165
92984599288,20cyclictest0-21swapper/322:25:173
92984599288,20cyclictest0-21swapper/322:25:173
92984099288,1cyclictest0-21swapper/123:55:161
92983499289,0cyclictest0-21swapper/023:50:160
929848992727,0cyclictest925013-21kworker/6:2+events19:50:216
92984699278,19cyclictest0-21swapper/422:05:214
92983499279,18cyclictest0-21swapper/000:20:130
92983499274,23cyclictest0-21swapper/022:00:220
92984999267,19cyclictest0-21swapper/720:40:227
92984899267,19cyclictest0-21swapper/622:10:136
92984899266,1cyclictest0-21swapper/622:40:186
92984699267,19cyclictest0-21swapper/420:35:174
92983499268,18cyclictest0-21swapper/021:55:170
929849992525,0cyclictest0-21swapper/700:09:177
92983499256,19cyclictest0-21swapper/022:20:150
92984999245,19cyclictest0-21swapper/720:20:187
92984899245,19cyclictest0-21swapper/623:55:166
92984799245,19cyclictest0-21swapper/520:25:245
92984699245,19cyclictest0-21swapper/419:35:224
92983499246,18cyclictest0-21swapper/023:35:220
92983499245,19cyclictest0-21swapper/020:05:160
92984999230,0cyclictest0-21swapper/722:28:517
92984999230,0cyclictest0-21swapper/722:28:517
929848992323,0cyclictest925013-21kworker/6:2+events22:25:176
929848992323,0cyclictest925013-21kworker/6:2+events22:25:176
92984099230,0cyclictest0-21swapper/120:16:181
929849992219,3cyclictest0-21swapper/700:27:257
929848992222,0cyclictest925013-21kworker/6:2+events20:05:016
929848992222,0cyclictest1041935-21kworker/6:1+events23:10:016
929848992222,0cyclictest1041935-21kworker/6:1+events22:55:006
92984699223,19cyclictest0-21swapper/421:30:184
92983499220,22cyclictest0-21swapper/022:19:120
92983499220,22cyclictest0-21swapper/022:19:120
929849992121,0cyclictest0-21swapper/721:36:417
929849992121,0cyclictest0-21swapper/721:36:417
929849992118,3cyclictest236199-21snmpd19:35:507
92984899212,19cyclictest0-21swapper/623:15:226
929848992121,0cyclictest1041935-21kworker/6:1+events00:28:016
929848992120,1cyclictest1073057-21ethtool23:30:166
92984699211,0cyclictest0-21swapper/422:20:184
92984599211,19cyclictest0-21swapper/320:10:153
929849992020,0cyclictest962560-21ethtool20:10:147
929849992019,1cyclictest236199-21snmpd20:28:457
929848992020,0cyclictest925013-21kworker/6:2+events22:20:356
929848992020,0cyclictest925013-21kworker/6:2+events22:00:076
929848992020,0cyclictest925013-21kworker/6:2+events21:50:096
929848992020,0cyclictest925013-21kworker/6:2+events21:45:196
929848992020,0cyclictest925013-21kworker/6:2+events21:31:036
929848992020,0cyclictest925013-21kworker/6:2+events21:25:516
929848992020,0cyclictest925013-21kworker/6:2+events21:20:136
929848992020,0cyclictest925013-21kworker/6:2+events21:05:056
929848992020,0cyclictest925013-21kworker/6:2+events20:55:236
929848992020,0cyclictest925013-21kworker/6:2+events20:45:076
929848992020,0cyclictest925013-21kworker/6:2+events20:25:576
929848992020,0cyclictest925013-21kworker/6:2+events20:15:406
929848992020,0cyclictest925013-21kworker/6:2+events20:05:036
929848992020,0cyclictest925013-21kworker/6:2+events19:45:056
929848992020,0cyclictest925013-21kworker/6:2+events19:35:216
929848992020,0cyclictest925013-21kworker/6:2+events19:25:196
929848992020,0cyclictest925013-21kworker/6:2+events19:20:216
929848992020,0cyclictest925013-21kworker/6:2+events19:10:176
929848992020,0cyclictest1084234-21ethtool23:50:156
929848992020,0cyclictest1041935-21kworker/6:1+events23:40:296
929848992020,0cyclictest1041935-21kworker/6:1+events23:25:036
929848992020,0cyclictest1041935-21kworker/6:1+events23:10:536
929848992020,0cyclictest1041935-21kworker/6:1+events22:45:036
929848992020,0cyclictest1041935-21kworker/6:1+events00:35:296
929848992020,0cyclictest1041935-21kworker/6:1+events00:20:096
929848992020,0cyclictest1041935-21kworker/6:1+events00:05:156
929848992019,1cyclictest1026415-21ethtool22:05:156
929847992020,0cyclictest940221-21mii-tool19:30:165
929847992020,0cyclictest236199-21snmpd00:35:255
929847992020,0cyclictest1075785-21mii-tool23:35:165
929847992020,0cyclictest1031885-21mii-tool22:15:165
929847992020,0cyclictest1031885-21mii-tool22:15:165
929847992019,1cyclictest978998-21mii-tool20:40:165
929847992019,1cyclictest1064887-21mii-tool23:15:175
929847992019,1cyclictest1056719-21ethtool23:00:165
929846992020,0cyclictest1059445-21mii-tool23:05:164
929846992019,1cyclictest236199-21snmpd22:47:254
929846992019,1cyclictest236199-21snmpd19:24:174
929845992019,1cyclictest236199-21snmpd22:52:013
929845992019,1cyclictest236199-21snmpd22:34:303
929845992019,1cyclictest236199-21snmpd22:34:303
92984599201,19cyclictest0-21swapper/320:54:473
92984599200,20cyclictest0-21swapper/322:38:223
92984599200,20cyclictest0-21swapper/321:15:223
92984599200,19cyclictest0-21swapper/300:36:313
92983499200,20cyclictest0-21swapper/022:35:360
92983499200,20cyclictest0-21swapper/019:15:220
929849991919,0cyclictest992912-21ethtool21:05:167
929849991919,0cyclictest236199-21snmpd19:10:497
929849991919,0cyclictest1089811-21mii-tool00:00:147
929849991919,0cyclictest1073081-21mii-tool23:30:167
929849991918,1cyclictest981736-21cat20:45:167
929849991918,1cyclictest236199-21snmpd00:10:157
929849991918,1cyclictest0-21swapper/720:16:037
92984999190,1cyclictest0-21swapper/719:32:327
92984999190,19cyclictest0-21swapper/723:54:457
92984999190,19cyclictest0-21swapper/723:36:017
92984999190,19cyclictest0-21swapper/723:00:167
92984999190,19cyclictest0-21swapper/722:16:277
92984999190,19cyclictest0-21swapper/722:16:267
92984999190,19cyclictest0-21swapper/719:45:147
92984999190,0cyclictest0-21swapper/722:51:377
92984999190,0cyclictest0-21swapper/700:37:197
929847991919,0cyclictest989912-21mii-tool21:00:165
929847991919,0cyclictest956862-21ethtool20:00:165
929847991919,0cyclictest942941-21ethtool19:35:165
929847991919,0cyclictest934507-21ethtool19:20:175
929847991919,0cyclictest1103444-21mii-tool00:25:175
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional