You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-12 - 02:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sun Apr 12, 2026 00:56:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17296999730,83cyclictest0-21swapper/000:01:440
172969973010,125cyclictest0-21swapper/000:22:240
17296997231,211cyclictest1551-21snmpd20:57:560
172969971982,84cyclictest0-21swapper/022:42:040
173019970567,211cyclictest0-21swapper/520:34:315
1730199681595,84cyclictest551rcuc/522:53:235
1730199681595,84cyclictest551rcuc/522:53:235
1730199681595,84cyclictest551rcuc/522:53:225
172969967235,507cyclictest0-21swapper/023:05:350
172969967235,507cyclictest0-21swapper/023:05:340
172969967235,507cyclictest0-21swapper/023:05:340
172969967235,507cyclictest0-21swapper/023:05:340
172969967176,42cyclictest121rcu_preempt22:54:460
172969967176,42cyclictest121rcu_preempt22:54:460
172969967176,42cyclictest121rcu_preempt22:54:450
1729699668116,549cyclictest17294-21cyclictest00:26:260
172979965926,382cyclictest0-21swapper/100:21:121
172979965622,84cyclictest0-21swapper/122:34:341
173039965255,338cyclictest0-21swapper/700:39:207
17298996428,3cyclictest0-21swapper/200:21:112
1729999641256,211cyclictest401ktimersoftd/300:40:053
17299996406,3cyclictest0-21swapper/300:21:123
1729999640170,338cyclictest17294-21cyclictest22:42:523
17302996351,383cyclictest0-21swapper/600:21:116
173029963486,126cyclictest0-21swapper/622:42:466
17301996341,383cyclictest0-21swapper/500:21:125
172979963481,338cyclictest16285-21diskmemload22:43:151
1729899633122,508cyclictest0-21swapper/200:38:272
1730399632125,126cyclictest0-21swapper/723:40:017
1730399630121,380cyclictest0-21swapper/700:30:217
173009962838,84cyclictest0-21swapper/423:55:074
173029962431,126cyclictest0-21swapper/623:29:066
1729799624286,84cyclictest10477-21kworker/u16:200:12:031
1730099623115,126cyclictest0-21swapper/400:23:414
1730099622114,126cyclictest0-21swapper/423:03:034
1730199616532,3cyclictest551rcuc/500:01:335
172999961666,126cyclictest0-21swapper/319:39:403
172969961624,513cyclictest0-21swapper/019:38:410
172969961419,592cyclictest0-21swapper/023:37:060
172999961320,126cyclictest32119-21cstates00:30:213
1730199608565,41cyclictest551rcuc/500:14:225
172999960291,338cyclictest0-21swapper/322:55:023
17296995995,591cyclictest0-21swapper/021:48:050
172999959847,128cyclictest0-21swapper/319:40:143
172999959786,380cyclictest13136-21rm00:37:223
1729899595552,41cyclictest311rcuc/223:26:592
173039959283,127cyclictest0-21swapper/700:21:397
173009959180,126cyclictest0-21swapper/421:49:214
172989959079,341cyclictest0-21swapper/200:30:192
172979958733,338cyclictest0-21swapper/123:54:351
1730299586291,211cyclictest641ktimersoftd/621:49:446
172969958636,383cyclictest0-21swapper/000:39:120
173039958574,126cyclictest0-21swapper/722:54:537
173039958574,126cyclictest0-21swapper/722:54:537
173039958574,126cyclictest0-21swapper/722:54:527
173029958434,84cyclictest0-21swapper/600:05:026
1729799583115,295cyclictest23913-21munin-run00:05:021
172999958271,296cyclictest0-21swapper/322:51:443
172999958271,296cyclictest0-21swapper/322:51:443
173039958026,127cyclictest121rcu_preempt22:33:527
173019958071,211cyclictest0-21swapper/523:39:255
172999957524,126cyclictest0-21swapper/323:02:083
172969957421,465cyclictest0-21swapper/023:18:590
173009957361,338cyclictest121rcu_preempt00:36:044
173009957021,296cyclictest0-21swapper/423:07:144
173009957021,296cyclictest0-21swapper/423:07:144
173009957021,296cyclictest0-21swapper/423:07:144
173009957021,296cyclictest0-21swapper/423:07:144
1730299569142,296cyclictest10665-21ssh23:38:126
1730399568269,127cyclictest0-21swapper/700:01:407
172969956862,126cyclictest0-21swapper/023:00:540
172969956814,465cyclictest0-21swapper/000:12:040
172999956514,127cyclictest0-21swapper/300:28:253
172969956412,168cyclictest0-21swapper/022:34:590
172989956293,296cyclictest0-21swapper/223:17:002
17296995619,465cyclictest28327-21diskmemload23:10:420
172979955952,296cyclictest0-21swapper/123:40:001
17300995585,296cyclictest0-21swapper/422:44:174
17299995521,85cyclictest0-21swapper/323:52:583
17297995521,126cyclictest0-21swapper/123:16:521
173029955183,295cyclictest0-21swapper/600:40:116
1730299551124,338cyclictest0-21swapper/600:30:216
173039954937,84cyclictest121rcu_preempt21:49:097
172999954879,381cyclictest0-21swapper/323:36:153
172999954878,338cyclictest0-21swapper/323:19:183
17296995480,3cyclictest0-21swapper/023:27:440
173019954739,126cyclictest0-21swapper/500:40:555
173039954475,299cyclictest25398-21ssh23:09:517
173039954475,299cyclictest25398-21ssh23:09:517
173039954475,299cyclictest25398-21ssh23:09:517
173039954475,299cyclictest25398-21ssh23:09:517
173019954375,465cyclictest0-21swapper/523:05:285
173019954375,465cyclictest0-21swapper/523:05:285
173019954375,465cyclictest0-21swapper/523:05:275
173019954375,465cyclictest0-21swapper/523:05:275
172969954332,380cyclictest0-21swapper/000:30:410
173009954272,297cyclictest0-21swapper/423:39:364
1729899542115,295cyclictest0-21swapper/200:28:252
172979954235,422cyclictest10445-1kworker/u17:000:26:371
173019954175,211cyclictest0-21swapper/522:09:455
172999954133,339cyclictest0-21swapper/300:14:363
172989954134,84cyclictest0-21swapper/223:55:112
172979954172,296cyclictest0-21swapper/123:55:341
1730199540456,3cyclictest551rcuc/500:39:125
172979954074,126cyclictest17294-21cyclictest00:30:461
172969954072,465cyclictest0-21swapper/020:33:300
173039953972,211cyclictest0-21swapper/723:16:477
173039953931,90cyclictest0-21swapper/723:52:577
1729699539117,211cyclictest121rcu_preempt21:00:130
172999953872,211cyclictest0-21swapper/300:01:363
1729799537115,338cyclictest2628350kworker/1:200:36:391
1729899536109,296cyclictest0-21swapper/223:10:012
1729899536109,296cyclictest0-21swapper/223:10:012
1729899536109,296cyclictest0-21swapper/223:10:012
173019953425,127cyclictest0-21swapper/500:28:025
172989953427,84cyclictest0-21swapper/223:52:372
173009953334,372cyclictest0-21swapper/400:13:514
1730099532192,338cyclictest64450irq/122-eth023:16:474
173009953120,380cyclictest0-21swapper/400:01:454
173009953019,339cyclictest0-21swapper/423:29:054
173039952921,296cyclictest0-21swapper/700:26:217
1730199529105,211cyclictest57-21ksoftirqd/522:34:315
173029952862,211cyclictest0-21swapper/623:04:586
1729899528271,126cyclictest11514-21kworker/u16:000:01:352
1730099527144,126cyclictest121rcu_preempt23:10:194
172999952620,295cyclictest41-21ksoftirqd/323:28:383
172989952412,296cyclictest8451-21diskmemload00:14:362
1729999523103,336cyclictest21716-21nscd22:34:043
173029952151,296cyclictest0-21swapper/623:54:536
1730199519264,253cyclictest561ktimersoftd/523:28:405
172989951912,256cyclictest0-21swapper/223:04:492
172999951748,296cyclictest0-21swapper/323:09:153
172999951748,296cyclictest0-21swapper/323:09:153
172999951748,296cyclictest0-21swapper/323:09:153
172999951748,296cyclictest0-21swapper/323:09:143
172979951710,84cyclictest698-21ptp4l22:09:331
1730199514172,169cyclictest0-21swapper/523:18:015
17300995121,338cyclictest0-21swapper/423:40:094
17303995090,84cyclictest15963-21sh22:10:057
1730299508124,381cyclictest0-21swapper/600:38:276
1730299507167,338cyclictest10445-1kworker/u17:000:26:536
17297995071,126cyclictest0-21swapper/123:07:121
17297995071,126cyclictest0-21swapper/123:07:121
17297995071,126cyclictest0-21swapper/123:07:121
17297995071,126cyclictest0-21swapper/123:07:111
17296995070,3cyclictest0-21swapper/023:52:400
173009950641,212cyclictest0-21swapper/400:25:184
172969950641,385cyclictest0-21swapper/022:09:570
173029950540,380cyclictest0-21swapper/622:45:116
1730399504122,128cyclictest0-21swapper/700:11:067
172989950376,211cyclictest0-21swapper/222:52:072
172989950376,211cyclictest0-21swapper/222:52:072
172989950376,211cyclictest0-21swapper/222:52:062
172969950334,466cyclictest0-21swapper/022:55:150
173009950234,337cyclictest0-21swapper/422:08:454
172989950237,84cyclictest704-21nscd22:42:512
172979950280,84cyclictest121rcu_preempt22:35:091
173039949934,86cyclictest0-21swapper/723:04:207
1730299499203,84cyclictest22180-1kworker/u17:023:06:006
1730299499203,84cyclictest22180-1kworker/u17:023:06:006
1730299499203,84cyclictest22180-1kworker/u17:023:06:006
1730299499203,84cyclictest22180-1kworker/u17:023:06:006
173009949976,168cyclictest121rcu_preempt20:35:014
173009949931,42cyclictest0-21swapper/422:34:054
172989949977,84cyclictest0-21swapper/223:09:292
172969949973,84cyclictest17294-21cyclictest23:30:100
172969949829,424cyclictest0-21swapper/020:35:120
1730399494193,211cyclictest0-21swapper/723:55:117
1730299494238,254cyclictest641ktimersoftd/623:55:306
173019949429,43cyclictest0-21swapper/522:44:305
172979949165,296cyclictest0-21swapper/120:57:391
172979949125,126cyclictest0-21swapper/123:03:011
172969949127,126cyclictest24859-21diskmemload00:40:430
172989948866,256cyclictest8552-21ssh21:49:512
1729799488107,126cyclictest26118-21chrt23:10:121
173009948721,126cyclictest0-21swapper/422:53:274
173009948721,126cyclictest0-21swapper/422:53:264
173009948721,126cyclictest0-21swapper/422:53:264
173019948664,84cyclictest0-21swapper/523:55:385
1729999486105,296cyclictest9956-21sh23:55:283
172989948663,254cyclictest0-21swapper/223:38:172
1729999485229,254cyclictest24859-21diskmemload22:45:163
172969948520,3cyclictest0-21swapper/023:55:070
173009948416,169cyclictest0-21swapper/422:35:174
173029948211,338cyclictest0-21swapper/620:33:156
173019948254,211cyclictest57-21ksoftirqd/523:51:435
173009948213,380cyclictest0-21swapper/400:15:364
173019948114,126cyclictest17976-21ssh23:02:405
1730299480139,168cyclictest121rcu_preempt22:08:216
173019947855,126cyclictest121rcu_preempt20:57:385
172999947812,84cyclictest17294-21cyclictest23:10:353
173039947652,126cyclictest0-21swapper/723:27:467
173009947611,84cyclictest0-21swapper/422:55:084
172999947591,253cyclictest18892-21perf21:00:033
17300994747,83cyclictest5137-21ssh23:52:074
17301994717,83cyclictest7017-21sh21:48:085
172969947145,211cyclictest0-21swapper/000:15:330
172969946379,253cyclictest121rcu_preempt22:45:020
173039946240,253cyclictest0-21swapper/720:58:207
1730399462121,338cyclictest24859-21diskmemload22:44:367
172999946239,126cyclictest121rcu_preempt00:15:113
1730199461120,338cyclictest0-21swapper/500:30:405
172999946139,84cyclictest0-21swapper/321:49:443
172979946181,135cyclictest17294-21cyclictest23:27:281
1730199460161,84cyclictest121rcu_preempt23:10:225
173009945932,83cyclictest0-21swapper/400:30:394
1730299458159,126cyclictest0-21swapper/600:13:036
172979945837,255cyclictest0-21swapper/122:53:521
172979945837,255cyclictest0-21swapper/122:53:521
172979945837,255cyclictest0-21swapper/122:53:511
1729799458160,84cyclictest121rcu_preempt00:15:131
172979945735,256cyclictest241ktimersoftd/120:33:391
173029945677,295cyclictest0-21swapper/622:53:276
173029945677,295cyclictest0-21swapper/622:53:276
173029945677,295cyclictest0-21swapper/622:53:276
173029945629,253cyclictest0-21swapper/623:10:406
172969945672,253cyclictest121rcu_preempt22:35:200
173029945576,295cyclictest0-21swapper/600:15:396
173029945331,255cyclictest17294-21cyclictest22:34:346
1730299453110,211cyclictest65-21ksoftirqd/620:57:426
172979945331,256cyclictest0-21swapper/121:48:231
1729799453113,338cyclictest0-21swapper/119:39:471
1729799453110,126cyclictest12367-21ssh23:40:111
172969945227,422cyclictest0-21swapper/021:50:120
1730199451110,338cyclictest0-21swapper/522:55:165
172989945129,84cyclictest0-21swapper/220:34:032
172989945129,7cyclictest0-21swapper/222:08:242
172999945069,84cyclictest0-21swapper/323:30:123
172999944927,338cyclictest303-21systemd-journal20:34:563
173039944664,293cyclictest0-21swapper/720:34:547
172999944667,296cyclictest0-21swapper/321:00:123
172999944665,84cyclictest0-21swapper/322:09:503
172979944624,211cyclictest0-21swapper/100:40:421
172969944523,341cyclictest10482-21/usr/sbin/munin23:20:150
172989944116,127cyclictest0-21swapper/200:40:172
172979944156,211cyclictest25-21ksoftirqd/122:10:041
1730199440186,251cyclictest0-21swapper/522:45:155
173019944014,84cyclictest0-21swapper/522:10:055
173039943916,3cyclictest0-21swapper/719:40:057
173019943817,255cyclictest0-21swapper/500:15:325
1730199437143,211cyclictest561ktimersoftd/519:39:535
173009943699,83cyclictest121rcu_preempt20:35:084
172989943618,79cyclictest0-21swapper/200:15:192
172989943610,84cyclictest0-21swapper/223:10:272
172989943511,85cyclictest0-21swapper/222:35:202
173039943412,256cyclictest0-21swapper/720:35:137
173009943393,338cyclictest17294-21cyclictest22:45:114
172999943351,338cyclictest0-21swapper/322:35:173
172989943294,129cyclictest33-21ksoftirqd/223:20:082
17298994326,211cyclictest0-21swapper/220:58:202
17298994297,2cyclictest0-21swapper/219:40:042
1730099428131,126cyclictest121rcu_preempt19:39:254
1729899427128,127cyclictest33-21ksoftirqd/222:33:532
172969942787,338cyclictest0-21swapper/023:40:100
172999942683,211cyclictest41-21ksoftirqd/323:40:123
17303994251,253cyclictest0-21swapper/700:40:067
173019942544,84cyclictest0-21swapper/522:35:085
17301994253,256cyclictest0-21swapper/519:40:055
173039942482,126cyclictest73-21ksoftirqd/722:35:217
17297994241,295cyclictest19050-21fschecks_count22:45:171
173039942342,42cyclictest0-21swapper/722:09:427
17302994231,7cyclictest0-21swapper/623:16:376
17302994231,3cyclictest0-21swapper/623:40:126
1729999423379,41cyclictest401ktimersoftd/300:05:043
172979942382,338cyclictest0-21swapper/121:50:131
173039942284,83cyclictest0-21swapper/722:55:157
173039942283,84cyclictest0-21swapper/719:39:267
17302994221,255cyclictest0-21swapper/619:40:056
1730299421122,84cyclictest121rcu_preempt21:50:126
173039942082,84cyclictest0-21swapper/700:15:407
173039942041,2cyclictest0-21swapper/723:40:177
173029942078,126cyclictest0-21swapper/619:37:306
172979942041,295cyclictest0-21swapper/121:00:181
173039941980,84cyclictest0-21swapper/721:50:137
173009941979,338cyclictest0-21swapper/421:00:014
173009941979,337cyclictest0-21swapper/422:10:044
172999941977,339cyclictest0-21swapper/323:20:123
172999941938,296cyclictest0-21swapper/322:55:163
172969941979,338cyclictest0-21swapper/022:10:050
1730299418119,126cyclictest65-21ksoftirqd/622:10:056
173019941878,337cyclictest0-21swapper/523:40:165
172999941837,42cyclictest0-21swapper/321:50:113
173029941776,338cyclictest0-21swapper/622:35:056
173009941776,338cyclictest0-21swapper/400:40:174
173039941676,84cyclictest0-21swapper/723:10:337
172999941676,338cyclictest0-21swapper/322:10:053
173029941574,338cyclictest0-21swapper/621:00:126
173019941574,338cyclictest0-21swapper/521:50:105
173039941475,84cyclictest0-21swapper/722:45:107
173039941434,41cyclictest0-21swapper/721:00:127
172989941434,41cyclictest0-21swapper/221:00:112
173009941272,338cyclictest0-21swapper/421:50:134
173009941069,338cyclictest0-21swapper/419:40:104
173009940925,254cyclictest0-21swapper/400:05:074
172989940967,126cyclictest33-21ksoftirqd/223:40:102
172989940667,84cyclictest0-21swapper/222:55:152
1729899406106,127cyclictest33-21ksoftirqd/219:38:592
1729799406114,81cyclictest121rcu_preempt22:55:111
172969940666,338cyclictest0-21swapper/019:40:100
172989940523,126cyclictest0-21swapper/222:45:022
173029940363,338cyclictest0-21swapper/623:20:166
172999940263,84cyclictest0-21swapper/320:35:113
173039940019,169cyclictest73-21ksoftirqd/723:30:117
173039939961,85cyclictest0-21swapper/723:20:087
173009939958,338cyclictest0-21swapper/423:30:084
172979939959,338cyclictest0-21swapper/123:20:151
172989939859,84cyclictest0-21swapper/220:35:102
172989939818,127cyclictest321ktimersoftd/222:10:052
172979939655,338cyclictest0-21swapper/123:30:071
172989939210,84cyclictest0-21swapper/221:50:062
172979939213,255cyclictest0-21swapper/120:35:131
173009938851,253cyclictest0-21swapper/423:20:074
1729799382127,126cyclictest25-21ksoftirqd/119:40:151
17301993811,84cyclictest0-21swapper/521:00:135
173029936729,135cyclictest0-21swapper/622:55:086
173019935719,84cyclictest0-21swapper/523:20:165
173009935717,337cyclictest0-21swapper/421:00:134
172989935514,126cyclictest0-21swapper/223:30:112
173019935114,171cyclictest0-21swapper/520:35:135
172979933741,214cyclictest0-21swapper/100:05:071
172989932631,84cyclictest0-21swapper/200:05:072
173029932526,169cyclictest4123-21apt20:35:136
172969932025,211cyclictest0-21swapper/000:05:050
173019931622,210cyclictest0-21swapper/523:30:085
17303992984,84cyclictest0-21swapper/700:05:047
173019929032,84cyclictest0-21swapper/500:05:055
173029928932,126cyclictest65-21ksoftirqd/623:30:096
173029928065,84cyclictest121rcu_preempt00:05:056
1680221130,1sleep10-21swapper/121:20:581
1659728961,5sleep50-21swapper/519:06:125
1664928843,9sleep00-21swapper/019:06:550
1669028352,28sleep20-21swapper/219:07:282
1654628251,28sleep10-21swapper/119:05:271
1663628149,28sleep70-21swapper/719:06:457
1427028150,8sleep30-21swapper/319:05:063
1674128050,27sleep60-21swapper/619:08:146
1427127947,28sleep40-21swapper/419:05:074
17299993023,6cyclictest0-21swapper/320:07:213
17299993010,20cyclictest0-21swapper/319:13:493
17299992910,18cyclictest0-21swapper/319:18:593
17303992828,0cyclictest0-21swapper/721:21:177
17303992810,18cyclictest0-21swapper/721:42:027
17302992810,17cyclictest0-21swapper/619:19:016
17299992810,18cyclictest0-21swapper/321:41:293
17299992810,0cyclictest0-21swapper/319:55:553
17298992810,17cyclictest0-21swapper/221:42:022
17298992810,17cyclictest0-21swapper/221:21:142
17297992810,18cyclictest0-21swapper/119:13:521
17296992810,18cyclictest0-21swapper/019:14:130
17303992727,0cyclictest0-21swapper/719:55:557
17303992727,0cyclictest0-21swapper/719:13:557
17303992710,17cyclictest0-21swapper/720:54:547
17303992710,17cyclictest0-21swapper/720:06:487
17303992710,0cyclictest0-21swapper/720:18:217
17303992710,0cyclictest0-21swapper/719:26:057
17303992710,0cyclictest0-21swapper/719:19:007
17302992710,17cyclictest0-21swapper/621:21:206
17302992710,17cyclictest0-21swapper/620:06:466
17302992710,17cyclictest0-21swapper/619:25:566
17302992710,0cyclictest0-21swapper/621:41:256
17302992710,0cyclictest0-21swapper/620:54:546
17302992710,0cyclictest0-21swapper/620:18:266
17302992710,0cyclictest0-21swapper/619:55:566
17302992710,0cyclictest0-21swapper/619:13:496
17301992727,0cyclictest0-21swapper/519:13:465
17301992710,17cyclictest0-21swapper/521:21:165
17301992710,17cyclictest0-21swapper/520:18:195
17301992710,17cyclictest0-21swapper/520:06:485
17301992710,0cyclictest0-21swapper/521:41:205
17301992710,0cyclictest0-21swapper/519:56:255
17301992710,0cyclictest0-21swapper/519:26:015
17301992710,0cyclictest0-21swapper/519:19:105
17300992727,0cyclictest0-21swapper/419:13:514
17300992710,17cyclictest0-21swapper/420:18:174
17300992710,17cyclictest0-21swapper/420:07:144
17300992710,17cyclictest0-21swapper/419:55:544
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional