You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-03 - 04:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7.osadl.org (updated Fri Apr 03, 2026 00:46:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
408995991210,119cyclictest0-21swapper/423:25:014
40899799109109,0cyclictest0-21swapper/619:55:166
408995998324,59cyclictest441713-21chrt20:07:464
40899599824,59cyclictest509912-21meminfo22:10:174
40899599824,59cyclictest509912-21meminfo22:10:174
408994997639,19cyclictest511ktimers/321:20:153
408995997537,19cyclictest498245-21grep21:50:144
408995997416,39cyclictest437397-21awk20:00:144
408995997013,38cyclictest4062491-21kworker/u32:5+events_unbound19:25:044
408995996929,39cyclictest586519-21sed00:30:014
408995996911,39cyclictest458126-21sed20:35:224
408991996968,1cyclictest0-21swapper/020:25:180
40899199690,67cyclictest0-21swapper/023:25:010
40899599678,58cyclictest486089-21munin-run21:30:014
408995996729,38cyclictest428433-21/usr/sbin/munin19:45:164
408995996527,19cyclictest540454-21missed_timers23:05:174
408995996022,19cyclictest601ktimers/421:40:184
408991996022,38cyclictest171ktimers/020:50:140
408995995738,19cyclictest408986-21cyclictest00:01:354
40899599570,38cyclictest474264-21cat21:05:244
408995995638,18cyclictest601ktimers/419:14:324
408995995618,19cyclictest551248-21expr23:25:134
408995995419,15cyclictest0-21swapper/422:33:174
408995995417,18cyclictest583788-21munin-run00:25:024
408995995414,39cyclictest0-21swapper/422:44:214
408997995313,39cyclictest0-21swapper/600:15:166
408995995335,18cyclictest601ktimers/400:31:174
408995995315,19cyclictest575399-21munin-run00:10:014
408995995315,19cyclictest558219-21users23:35:244
408995995314,39cyclictest0-21swapper/422:00:214
408995995314,39cyclictest0-21swapper/421:47:094
408995995314,39cyclictest0-21swapper/421:47:084
408995995314,39cyclictest0-21swapper/421:36:414
408995995314,39cyclictest0-21swapper/419:53:434
408995995314,39cyclictest0-21swapper/400:14:204
408995995314,19cyclictest0-21swapper/422:15:344
408995995312,40cyclictest523714-21ntpq22:35:214
408996995233,19cyclictest0-21swapper/522:05:165
408996995233,19cyclictest0-21swapper/522:05:155
408995995233,19cyclictest601ktimers/423:40:234
408995995233,19cyclictest0-21swapper/423:00:024
408995995233,19cyclictest0-21swapper/420:10:084
408995995213,39cyclictest0-21swapper/423:46:344
408995995213,39cyclictest0-21swapper/422:07:254
408995995213,39cyclictest0-21swapper/422:07:244
408995995213,39cyclictest0-21swapper/420:55:344
408995995213,39cyclictest0-21swapper/420:32:064
408995995213,39cyclictest0-21swapper/420:27:514
408998995113,19cyclictest0-21swapper/723:35:167
408995995133,18cyclictest0-21swapper/423:19:454
408995995133,18cyclictest0-21swapper/422:21:534
408995995133,18cyclictest0-21swapper/420:20:084
408995995133,18cyclictest0-21swapper/419:37:364
408995995133,18cyclictest0-21swapper/400:15:494
408995995132,19cyclictest0-21swapper/423:14:364
408995995113,19cyclictest483364-21munin-run21:25:004
408995995113,19cyclictest236199-21snmpd21:10:164
408995995112,39cyclictest873-21mta-sts-daemon23:32:414
408995995112,39cyclictest0-21swapper/422:57:094
408995995112,39cyclictest0-21swapper/420:45:224
408995995112,39cyclictest0-21swapper/420:42:054
408993995113,19cyclictest0-21swapper/222:25:162
408991995113,19cyclictest0-21swapper/020:40:160
408997995013,18cyclictest0-21swapper/619:10:166
408996995011,39cyclictest0-21swapper/500:25:165
408995995032,18cyclictest0-21swapper/421:34:044
408995995032,18cyclictest0-21swapper/420:52:534
408995995032,18cyclictest0-21swapper/419:23:024
408995995032,18cyclictest0-21swapper/400:37:094
408995995031,19cyclictest0-21swapper/423:56:134
408995995031,19cyclictest0-21swapper/422:50:104
408995995031,19cyclictest0-21swapper/419:33:544
408995995011,39cyclictest0-21swapper/423:54:374
408995995011,39cyclictest0-21swapper/421:57:174
408995995011,39cyclictest0-21swapper/421:57:164
408997994931,18cyclictest0-21swapper/620:45:156
408997994910,39cyclictest0-21swapper/622:30:176
408995994931,18cyclictest601ktimers/421:02:154
408995994931,18cyclictest0-21swapper/420:15:454
408995994931,18cyclictest0-21swapper/419:40:254
408995994910,39cyclictest0-21swapper/422:48:034
408995994910,39cyclictest0-21swapper/419:57:144
408997994810,19cyclictest0-21swapper/623:30:136
40899599489,39cyclictest0-21swapper/421:18:154
40899599489,19cyclictest0-21swapper/419:19:434
408991994810,19cyclictest0-21swapper/021:05:180
40899799479,19cyclictest0-21swapper/623:55:146
408997994729,0cyclictest0-21swapper/621:45:146
408997994729,0cyclictest0-21swapper/621:45:146
40899699479,19cyclictest0-21swapper/519:35:155
40899199470,47cyclictest0-21swapper/021:40:160
40899199468,19cyclictest0-21swapper/019:45:160
40899199468,19cyclictest0-21swapper/000:35:160
40899199467,39cyclictest0-21swapper/019:20:150
40899799456,39cyclictest0-21swapper/622:15:156
40899399455,39cyclictest0-21swapper/220:45:152
40899299457,19cyclictest0-21swapper/119:40:161
40899299456,39cyclictest0-21swapper/119:50:161
40899299435,19cyclictest0-21swapper/100:25:161
408996994224,18cyclictest0-21swapper/519:45:155
40899499423,39cyclictest0-21swapper/319:25:153
408998994141,0cyclictest0-21swapper/719:20:147
40899799402,19cyclictest0-21swapper/620:05:166
408992994021,19cyclictest0-21swapper/123:40:151
40899899390,39cyclictest0-21swapper/720:40:167
40899899390,37cyclictest0-21swapper/722:45:167
40899399391,38cyclictest0-21swapper/220:05:162
40899399390,20cyclictest0-21swapper/223:50:142
40899199391,19cyclictest0-21swapper/022:20:170
408998993819,19cyclictest0-21swapper/723:20:157
408993993819,19cyclictest0-21swapper/222:05:152
408993993819,19cyclictest0-21swapper/222:05:152
40899899370,18cyclictest0-21swapper/700:35:157
408994993718,18cyclictest0-21swapper/319:40:153
40899299370,18cyclictest0-21swapper/120:09:431
40899899360,35cyclictest0-21swapper/721:55:157
40899899360,35cyclictest0-21swapper/721:55:147
40899899360,17cyclictest0-21swapper/722:10:157
40899899360,17cyclictest0-21swapper/722:10:157
40899899360,17cyclictest0-21swapper/720:00:147
408997993618,18cyclictest79-21ksoftirqd/622:45:166
40899699360,36cyclictest0-21swapper/521:45:155
40899699360,36cyclictest0-21swapper/521:45:145
40899699360,17cyclictest0-21swapper/522:20:185
40899599360,17cyclictest0-21swapper/422:25:174
40899499360,16cyclictest0-21swapper/300:00:163
408992993616,20cyclictest559033-21kworker/u32:123:55:111
40899899350,16cyclictest0-21swapper/720:20:147
40899899350,15cyclictest0-21swapper/700:00:167
408997993516,19cyclictest0-21swapper/600:00:156
40899799350,15cyclictest0-21swapper/600:25:176
40899299350,15cyclictest0-21swapper/119:25:151
40899199350,16cyclictest0-21swapper/021:15:190
40899899340,34cyclictest0-21swapper/723:45:177
40899899340,34cyclictest0-21swapper/721:45:157
40899899340,34cyclictest0-21swapper/721:45:147
40899799340,15cyclictest0-21swapper/622:50:126
40899499340,34cyclictest0-21swapper/320:00:143
40899499340,15cyclictest0-21swapper/322:45:163
40899399340,15cyclictest0-21swapper/222:10:162
40899399340,15cyclictest0-21swapper/222:10:152
40899399340,15cyclictest0-21swapper/219:25:162
40899399340,14cyclictest0-21swapper/220:30:142
408992993434,0cyclictest0-21swapper/121:00:591
408991993415,0cyclictest0-21swapper/023:05:150
408991993414,19cyclictest0-21swapper/022:00:150
408991993414,19cyclictest0-21swapper/021:30:150
408998993314,19cyclictest0-21swapper/723:30:137
408998993314,19cyclictest0-21swapper/722:25:177
408998993314,19cyclictest0-21swapper/721:35:157
408998993314,19cyclictest0-21swapper/720:25:187
408998993314,19cyclictest0-21swapper/720:10:157
408998993314,19cyclictest0-21swapper/719:40:167
408998993314,19cyclictest0-21swapper/719:10:157
408998993314,19cyclictest0-21swapper/700:10:167
408998993312,20cyclictest0-21swapper/722:55:157
408997993314,19cyclictest0-21swapper/623:35:156
408997993314,19cyclictest0-21swapper/623:05:166
408997993314,19cyclictest0-21swapper/622:55:166
408997993314,19cyclictest0-21swapper/622:35:186
408997993314,19cyclictest0-21swapper/622:10:166
408997993314,19cyclictest0-21swapper/622:10:156
408997993314,19cyclictest0-21swapper/621:50:176
408997993314,19cyclictest0-21swapper/620:55:156
408997993314,19cyclictest0-21swapper/600:20:146
408997993313,20cyclictest0-21swapper/600:10:166
408997993313,19cyclictest0-21swapper/619:25:156
408996993314,19cyclictest0-21swapper/521:50:175
408996993314,19cyclictest0-21swapper/521:05:175
408996993314,19cyclictest0-21swapper/521:00:155
408996993314,19cyclictest0-21swapper/500:05:165
408994993314,19cyclictest0-21swapper/321:10:163
408994993314,19cyclictest0-21swapper/320:25:173
408993993314,19cyclictest0-21swapper/222:45:172
408993993314,19cyclictest0-21swapper/222:30:162
408993993314,19cyclictest0-21swapper/222:00:142
408993993314,19cyclictest0-21swapper/221:20:162
408993993314,19cyclictest0-21swapper/220:15:152
408993993314,19cyclictest0-21swapper/220:10:162
408993993314,19cyclictest0-21swapper/219:50:152
408993993314,19cyclictest0-21swapper/200:30:192
408992993314,19cyclictest0-21swapper/123:45:231
408992993314,19cyclictest0-21swapper/121:31:001
408992993314,19cyclictest0-21swapper/121:10:171
408992993314,19cyclictest0-21swapper/120:35:151
408992993314,19cyclictest0-21swapper/119:30:511
408992993314,19cyclictest0-21swapper/119:10:151
408992993314,19cyclictest0-21swapper/100:20:151
408991993314,19cyclictest0-21swapper/023:15:160
408991993314,19cyclictest0-21swapper/021:20:150
408991993314,19cyclictest0-21swapper/020:20:140
408991993314,19cyclictest0-21swapper/019:50:160
408991993314,19cyclictest0-21swapper/000:30:180
408991993314,19cyclictest0-21swapper/000:15:150
408998993213,19cyclictest0-21swapper/723:15:157
408998993213,19cyclictest0-21swapper/720:15:167
408997993213,19cyclictest0-21swapper/620:00:146
408996993214,18cyclictest0-21swapper/520:10:165
408996993213,19cyclictest0-21swapper/523:25:165
408994993213,19cyclictest0-21swapper/319:30:153
408993993213,19cyclictest0-21swapper/223:45:162
408993993213,19cyclictest0-21swapper/223:25:162
408993993213,19cyclictest0-21swapper/223:20:162
408993993213,19cyclictest0-21swapper/223:15:152
408993993213,19cyclictest0-21swapper/219:55:152
408993993212,19cyclictest0-21swapper/221:45:142
408993993212,19cyclictest0-21swapper/221:45:142
408992993214,18cyclictest0-21swapper/123:00:161
408992993213,19cyclictest0-21swapper/123:25:161
408992993213,19cyclictest0-21swapper/122:40:161
408992993213,19cyclictest0-21swapper/122:15:161
408991993214,0cyclictest0-21swapper/019:30:150
408991993213,19cyclictest0-21swapper/020:05:170
408991993213,19cyclictest0-21swapper/000:05:160
40899899319,22cyclictest0-21swapper/700:20:227
408998993112,19cyclictest0-21swapper/723:55:147
408998993112,19cyclictest0-21swapper/720:05:177
408998993112,19cyclictest0-21swapper/719:15:157
408997993112,19cyclictest0-21swapper/622:25:166
408997993112,19cyclictest0-21swapper/621:40:176
408996993112,19cyclictest0-21swapper/523:00:155
408996993112,19cyclictest0-21swapper/522:40:225
408996993112,19cyclictest0-21swapper/521:55:155
408996993112,19cyclictest0-21swapper/521:55:145
408996993112,19cyclictest0-21swapper/520:35:155
408996993112,19cyclictest0-21swapper/519:50:175
408996993112,19cyclictest0-21swapper/519:30:145
408994993113,18cyclictest0-21swapper/320:50:143
408994993112,19cyclictest0-21swapper/323:05:163
408993993113,18cyclictest0-21swapper/221:55:222
408993993113,18cyclictest0-21swapper/221:55:212
408993993112,19cyclictest0-21swapper/221:50:172
408993993111,19cyclictest0-21swapper/222:50:122
408992993111,19cyclictest549826-21kworker/5:123:31:091
408992993111,19cyclictest0-21swapper/100:30:191
408991993113,18cyclictest171ktimers/023:00:150
408991993112,19cyclictest0-21swapper/023:10:150
408991993112,19cyclictest0-21swapper/021:35:140
408991993112,19cyclictest0-21swapper/020:15:150
408998993011,19cyclictest0-21swapper/721:10:177
408998993011,19cyclictest0-21swapper/700:25:167
408997993011,19cyclictest0-21swapper/621:25:156
408996993011,19cyclictest0-21swapper/520:30:145
408993993011,19cyclictest0-21swapper/222:35:182
408993993011,19cyclictest0-21swapper/220:35:152
408992993012,18cyclictest0-21swapper/121:05:171
408992993011,19cyclictest0-21swapper/123:07:071
408992993011,19cyclictest0-21swapper/121:49:021
408992993011,19cyclictest0-21swapper/121:49:011
408992993011,19cyclictest0-21swapper/100:07:111
408991993011,19cyclictest0-21swapper/022:55:150
408991993011,19cyclictest0-21swapper/022:35:170
408998992910,19cyclictest0-21swapper/721:09:537
408997992910,19cyclictest0-21swapper/620:10:156
408996992910,19cyclictest0-21swapper/523:55:155
408996992910,19cyclictest0-21swapper/521:30:155
408996992910,19cyclictest0-21swapper/519:40:155
408994992910,19cyclictest0-21swapper/321:30:153
408994992910,19cyclictest0-21swapper/319:14:343
408992992910,19cyclictest0-21swapper/122:49:061
408992992910,19cyclictest0-21swapper/122:07:041
408992992910,19cyclictest0-21swapper/122:07:031
408992992910,19cyclictest0-21swapper/122:01:031
408991992910,19cyclictest0-21swapper/023:50:150
408991992910,19cyclictest0-21swapper/000:20:140
40899899289,19cyclictest0-21swapper/722:05:157
40899899289,19cyclictest0-21swapper/722:05:157
40899899289,19cyclictest0-21swapper/722:00:157
40899899288,19cyclictest0-21swapper/721:25:177
40899799289,19cyclictest0-21swapper/623:40:166
40899499289,19cyclictest0-21swapper/321:55:023
40899499289,19cyclictest0-21swapper/321:55:023
40899399289,19cyclictest0-21swapper/222:40:162
40899299289,19cyclictest0-21swapper/122:35:191
40899299289,19cyclictest0-21swapper/122:31:041
40899299289,19cyclictest0-21swapper/120:18:561
40899299289,19cyclictest0-21swapper/120:12:541
40899299289,19cyclictest0-21swapper/119:24:511
40899299287,20cyclictest474785-21kworker/0:221:18:591
408992992810,18cyclictest492097-21kworker/3:021:55:031
408992992810,18cyclictest492097-21kworker/3:021:55:021
40899199289,19cyclictest0-21swapper/019:55:160
408991992828,0cyclictest497595-21kworker/0:3+events22:45:190
40899899278,19cyclictest0-21swapper/721:15:187
40899899278,19cyclictest0-21swapper/719:30:157
40899899278,19cyclictest0-21swapper/700:05:167
40899799278,19cyclictest0-21swapper/619:50:156
40899499278,19cyclictest0-21swapper/321:15:193
408994992727,0cyclictest0-21swapper/300:20:103
40899299278,19cyclictest0-21swapper/123:19:081
40899299278,19cyclictest0-21swapper/122:25:051
40899299278,19cyclictest0-21swapper/122:20:231
40899299278,19cyclictest0-21swapper/121:24:591
40899299278,19cyclictest0-21swapper/120:00:531
40899299278,19cyclictest0-21swapper/119:48:521
40899899267,19cyclictest0-21swapper/720:54:537
40899799267,19cyclictest0-21swapper/623:20:156
40899799267,19cyclictest0-21swapper/621:15:176
40899799267,19cyclictest0-21swapper/619:20:156
40899699267,19cyclictest0-21swapper/521:25:155
40899299267,19cyclictest0-21swapper/120:54:581
40899299267,19cyclictest0-21swapper/120:30:551
40899299267,19cyclictest0-21swapper/119:18:511
40899299267,19cyclictest0-21swapper/100:19:121
40899299267,19cyclictest0-21swapper/100:13:131
40899199267,19cyclictest0-21swapper/023:45:160
40899299257,18cyclictest0-21swapper/100:37:141
40899299256,19cyclictest0-21swapper/123:13:081
40899299256,19cyclictest0-21swapper/122:13:031
40899299256,19cyclictest0-21swapper/122:13:031
40899299256,19cyclictest0-21swapper/121:43:011
40899299256,19cyclictest0-21swapper/120:48:571
40899299256,19cyclictest0-21swapper/120:24:551
40899799245,19cyclictest0-21swapper/621:20:166
40899799245,19cyclictest0-21swapper/600:30:186
40899399246,18cyclictest0-21swapper/200:05:162
40899299246,18cyclictest0-21swapper/100:01:111
40899199246,0cyclictest0-21swapper/021:10:170
40899799234,19cyclictest0-21swapper/619:15:156
40899499234,19cyclictest0-21swapper/319:19:343
40899299234,19cyclictest0-21swapper/121:50:161
408991992319,4cyclictest413097-21kworker/0:0+events20:30:220
40899899223,19cyclictest0-21swapper/722:37:497
40899899223,19cyclictest0-21swapper/721:40:167
40899699223,19cyclictest0-21swapper/523:40:155
40899199223,19cyclictest0-21swapper/020:55:150
40899899212,19cyclictest0-21swapper/723:05:157
40899899212,19cyclictest0-21swapper/719:25:217
40899799212,19cyclictest0-21swapper/619:35:156
40899199212,19cyclictest0-21swapper/022:05:050
40899199212,19cyclictest0-21swapper/022:05:040
408991992119,2cyclictest413097-21kworker/0:0+events20:35:180
408991992118,1cyclictest569189-21kworker/0:2+events00:10:120
408991992117,4cyclictest497595-21kworker/0:3+events22:50:140
40899199210,21cyclictest0-21swapper/021:59:240
40899199210,21cyclictest0-21swapper/021:59:240
40899899200,20cyclictest0-21swapper/723:25:227
40899899200,20cyclictest0-21swapper/720:55:107
40899899200,1cyclictest0-21swapper/721:21:147
408996992020,0cyclictest512391-21mii-tool22:15:165
40899699200,20cyclictest0-21swapper/520:53:075
408994992020,0cyclictest590165-21mii-tool00:35:163
408994992020,0cyclictest534719-21mii-tool22:55:153
408994992019,1cyclictest236199-21snmpd20:08:343
40899499200,20cyclictest0-21swapper/323:50:163
40899499200,20cyclictest0-21swapper/322:35:273
40899499200,20cyclictest0-21swapper/321:25:113
40899499200,20cyclictest0-21swapper/320:30:253
40899499200,20cyclictest0-21swapper/300:13:433
408993992020,0cyclictest576282-21mii-tool00:10:162
408993992020,0cyclictest554363-21ethtool23:30:142
408993992020,0cyclictest437419-21mii-tool20:00:152
408993992020,0cyclictest236199-21snmpd20:41:132
408993992019,1cyclictest479102-21ethtool21:15:172
40899399201,19cyclictest493029-21awk21:40:162
40899399200,20cyclictest0-21swapper/221:36:352
40899299200,19cyclictest0-21swapper/122:55:061
408991992020,0cyclictest574180-21kworker/0:0+events00:25:200
408991992020,0cyclictest569189-21kworker/0:2+events00:00:380
408991992020,0cyclictest547246-21kworker/0:1+events23:55:190
408991992020,0cyclictest547246-21kworker/0:1+events23:42:190
408991992020,0cyclictest497595-21kworker/0:3+events23:28:080
408991992020,0cyclictest497595-21kworker/0:3+events22:44:040
408991992020,0cyclictest497595-21kworker/0:3+events22:30:040
408991992020,0cyclictest497595-21kworker/0:3+events22:26:130
408991992020,0cyclictest497595-21kworker/0:3+events22:15:140
408991992020,0cyclictest497595-21kworker/0:3+events22:10:370
408991992020,0cyclictest497595-21kworker/0:3+events22:10:360
408991992020,0cyclictest497595-21kworker/0:3+events21:54:140
408991992020,0cyclictest483291-21kworker/0:1+events21:47:390
408991992020,0cyclictest483291-21kworker/0:1+events21:47:380
408991992020,0cyclictest483291-21kworker/0:1+events21:25:160
408991992020,0cyclictest413097-21kworker/0:0+events21:00:040
408991992020,0cyclictest413097-21kworker/0:0+events19:40:100
408991992020,0cyclictest413097-21kworker/0:0+events19:35:440
408991992020,0cyclictest413097-21kworker/0:0+events19:28:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional