You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 00:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Apr 14, 2026 12:57:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10103997297,719cyclictest0-21swapper/410:52:154
101059966329,84cyclictest0-21swapper/611:57:306
101059966166,84cyclictest0-21swapper/612:08:546
101059966166,84cyclictest0-21swapper/612:08:546
101059965214,550cyclictest121rcu_preempt09:58:246
101059964715,501cyclictest0-21swapper/612:49:446
101029964712,3cyclictest0-21swapper/310:52:313
10106996404,3cyclictest0-21swapper/710:52:327
10105996351,2cyclictest0-21swapper/611:29:156
1010299623537,84cyclictest391rcuc/309:58:433
1010499620112,126cyclictest0-21swapper/510:34:295
1010499618277,338cyclictest32497-1kworker/u17:011:33:125
101019961623,384cyclictest0-21swapper/211:29:142
101059961462,549cyclictest0-21swapper/612:16:346
1010699613102,508cyclictest0-21swapper/710:40:357
101049960696,507cyclictest0-21swapper/510:40:345
101039960292,507cyclictest29212-21timerwakeupswit10:40:344
1010299601132,296cyclictest0-21swapper/312:33:353
1010199597558,3cyclictest311rcuc/212:33:302
10100995940,84cyclictest0-21swapper/112:16:331
10106995930,84cyclictest0-21swapper/710:37:377
10104995931,383cyclictest0-21swapper/511:29:145
10104995930,83cyclictest0-21swapper/510:53:255
10101995930,84cyclictest11816-21sh10:53:252
101009959381,381cyclictest0-21swapper/111:58:111
100999958675,254cyclictest0-21swapper/010:57:160
1010699585501,2cyclictest711rcuc/712:16:307
101029957723,338cyclictest0-21swapper/312:19:163
1010199577108,296cyclictest0-21swapper/212:20:362
101069957626,425cyclictest17926-21ssh10:33:057
101059957668,84cyclictest0-21swapper/611:48:526
101029957224,381cyclictest10097-21cyclictest11:30:293
1010499570398,4cyclictest561ktimersoftd/511:18:145
1010499570398,4cyclictest561ktimersoftd/511:18:145
101009956960,507cyclictest0-21swapper/112:12:081
101059956622,119cyclictest0-21swapper/610:48:476
1010299565482,3cyclictest391rcuc/310:46:203
101019956315,374cyclictest0-21swapper/210:46:382
10105995616,507cyclictest0-21swapper/612:32:226
10106995570,85cyclictest0-21swapper/711:16:307
10106995570,85cyclictest0-21swapper/711:16:297
101059955748,127cyclictest29213-21timerwakeupswit10:40:346
1010199556128,211cyclictest0-21swapper/212:26:232
10102995522,384cyclictest0-21swapper/311:29:143
1010599547121,211cyclictest65-21ksoftirqd/610:55:276
101049954736,381cyclictest0-21swapper/510:45:125
101009954782,126cyclictest13793-1kworker/u17:012:33:361
100999954738,3cyclictest0-21swapper/007:59:400
1010699546120,423cyclictest0-21swapper/710:15:247
101009954435,42cyclictest121rcu_preempt10:42:331
1010699540457,3cyclictest711rcuc/712:07:357
1010699540457,3cyclictest711rcuc/712:07:347
101059954074,211cyclictest0-21swapper/611:33:136
1010299540117,338cyclictest0-21swapper/311:18:203
1010299540117,338cyclictest0-21swapper/311:18:203
1010199537109,211cyclictest29696-21sh11:59:102
1010099536282,50cyclictest241ktimersoftd/111:50:231
1010599533106,296cyclictest0-21swapper/610:33:526
101059953264,465cyclictest17726-21diskmemload12:14:586
101069953060,211cyclictest73-21ksoftirqd/710:56:497
101059953019,84cyclictest0-21swapper/610:37:146
101009952821,256cyclictest1551-21snmpd11:29:141
101019952517,126cyclictest10097-21cyclictest10:40:352
1010599523183,338cyclictest17779-1kworker/u17:010:00:176
100999951811,126cyclictest0-21swapper/010:34:290
10103995163,296cyclictest12279-21kworker/u16:310:36:304
1010599511170,126cyclictest121rcu_preempt11:35:056
101019951188,257cyclictest17904-21sh09:57:222
10106995100,83cyclictest0-21swapper/711:13:297
1010399510252,85cyclictest121rcu_preempt10:55:484
10104995090,84cyclictest0-21swapper/512:07:055
10104995090,84cyclictest0-21swapper/512:07:055
10103995093,255cyclictest0-21swapper/411:29:144
10103995090,84cyclictest0-21swapper/412:07:054
10103995090,84cyclictest0-21swapper/412:07:054
10102995090,84cyclictest0-21swapper/311:50:213
10101995090,84cyclictest0-21swapper/212:07:052
10101995090,84cyclictest0-21swapper/212:07:052
10099995093,255cyclictest0-21swapper/011:29:140
101009950683,84cyclictest0-21swapper/110:50:351
101069950434,84cyclictest0-21swapper/710:12:597
101029950334,388cyclictest0-21swapper/310:43:553
1010299503123,126cyclictest121rcu_preempt07:57:093
1010199503118,211cyclictest33-21ksoftirqd/211:00:252
1010599502372,85cyclictest20761-21ssh11:16:036
1010599502372,85cyclictest20761-21ssh11:16:036
101019950235,126cyclictest33-21ksoftirqd/212:00:362
101069950131,254cyclictest18950-21ssh12:13:057
101029950135,211cyclictest0-21swapper/310:57:213
101009950179,84cyclictest0-21swapper/110:13:191
1010099500199,84cyclictest0-21swapper/111:13:391
1009999500116,169cyclictest9-21ksoftirqd/012:31:570
101019949976,84cyclictest0-21swapper/212:16:392
101039949834,41cyclictest0-21swapper/411:30:444
101009949833,46cyclictest0-21swapper/112:03:161
1010099498242,253cyclictest704-21nscd09:58:401
1010099498201,127cyclictest121rcu_preempt10:23:521
1010399497114,380cyclictest0-21swapper/409:59:404
101019949730,123cyclictest26466-21apt10:40:002
101009949632,46cyclictest0-21swapper/111:32:011
100999949631,8cyclictest0-21swapper/010:43:230
101049949573,338cyclictest0-21swapper/512:12:225
101049949479,77cyclictest0-21swapper/512:31:365
101039949430,45cyclictest0-21swapper/411:17:474
101039949430,45cyclictest0-21swapper/411:17:464
101029949469,209cyclictest41-21ksoftirqd/309:39:533
101029949468,126cyclictest41-21ksoftirqd/311:49:373
1010299494109,169cyclictest41-21ksoftirqd/312:49:453
101039949226,84cyclictest0-21swapper/412:20:354
101059949165,423cyclictest7992-21runrttasks07:58:426
101039949170,84cyclictest0-21swapper/410:13:204
101029949165,126cyclictest21930-21/usr/sbin/munin10:00:223
101009949165,84cyclictest121rcu_preempt10:47:201
1009999491107,126cyclictest0-21swapper/011:35:080
1009999489105,381cyclictest0-21swapper/012:12:080
1010699488192,126cyclictest21874-21kworker/u16:309:39:317
100999948819,295cyclictest0-21swapper/010:22:480
101039948625,207cyclictest0-21swapper/410:34:104
101069948520,298cyclictest10097-21cyclictest08:24:277
100999948319,48cyclictest0-21swapper/011:50:290
101059948256,423cyclictest70932sleep610:50:076
101039948260,84cyclictest64450irq/122-eth012:34:364
1010699481101,126cyclictest0-21swapper/709:58:357
101059948116,383cyclictest0-21swapper/608:23:366
101059948114,464cyclictest0-21swapper/611:50:446
1010299481398,3cyclictest391rcuc/312:11:213
101019948112,126cyclictest121rcu_preempt11:18:572
101019948112,126cyclictest121rcu_preempt11:18:572
100999948198,126cyclictest9-21ksoftirqd/012:18:250
100999948115,300cyclictest26485-21munin-run10:40:040
10105994809,387cyclictest0-21swapper/610:15:326
101049948055,210cyclictest10097-21cyclictest10:35:555
101049948015,338cyclictest704-21nscd12:15:285
101039948053,211cyclictest0-21swapper/407:59:554
100999948016,3cyclictest0-21swapper/010:50:080
101039947915,298cyclictest0-21swapper/412:16:034
101049947821,36cyclictest0-21swapper/512:02:055
101069947719,290cyclictest0-21swapper/712:32:177
101039947798,295cyclictest0-21swapper/410:48:004
1009999477178,126cyclictest121rcu_preempt11:18:180
1009999477178,126cyclictest121rcu_preempt11:18:180
10105994768,465cyclictest0-21swapper/612:26:456
101029947661,330cyclictest0-21swapper/310:22:533
1010199476176,126cyclictest121rcu_preempt11:13:162
100999947553,84cyclictest0-21swapper/012:20:210
101049947489,211cyclictest0-21swapper/511:49:015
1010299474430,42cyclictest391rcuc/312:03:473
101019947187,381cyclictest0-21swapper/210:34:282
1010199471428,41cyclictest311rcuc/211:34:592
101039947012,289cyclictest0-21swapper/410:22:514
10105994680,465cyclictest0-21swapper/609:38:266
1010499468382,84cyclictest561ktimersoftd/512:48:215
10105994673,385cyclictest0-21swapper/612:01:206
1010599466298,43cyclictest0-21swapper/609:40:146
1010499466125,338cyclictest10097-21cyclictest09:57:405
10102994661,2cyclictest0-21swapper/310:39:443
101069946579,211cyclictest73-21ksoftirqd/710:24:237
10104994650,85cyclictest0-21swapper/511:57:415
10103994651,291cyclictest0-21swapper/411:50:274
101019946581,381cyclictest694-21irqbalance12:12:082
10101994650,3cyclictest0-21swapper/212:35:132
101069946481,126cyclictest0-21swapper/710:49:137
1010599464124,338cyclictest0-21swapper/611:00:186
101039946441,84cyclictest10097-21cyclictest12:00:194
10099994640,3cyclictest0-21swapper/011:31:490
101069946341,256cyclictest0-21swapper/711:48:197
1010699463121,339cyclictest0-21swapper/712:02:237
101009946379,126cyclictest0-21swapper/110:25:151
101069946240,256cyclictest0-21swapper/712:20:337
101029946176,126cyclictest41-21ksoftirqd/310:25:043
101029946138,256cyclictest0-21swapper/312:20:313
101029946138,256cyclictest0-21swapper/311:13:543
101019946137,3cyclictest0-21swapper/209:38:462
1010099461163,295cyclictest10097-21cyclictest12:35:031
1009999461120,338cyclictest0-21swapper/010:47:540
1009999461120,338cyclictest0-21swapper/010:14:520
101029946076,211cyclictest41-21ksoftirqd/312:09:143
101029946076,211cyclictest41-21ksoftirqd/312:09:133
1010299460121,84cyclictest0-21swapper/310:33:523
1010199460416,42cyclictest311rcuc/211:49:452
101009946039,337cyclictest0-21swapper/110:55:401
100999946033,296cyclictest0-21swapper/009:38:520
101049945929,126cyclictest121rcu_preempt09:39:495
101009945931,424cyclictest724-21nscd11:00:051
101039945832,168cyclictest0-21swapper/408:24:084
1010399458116,126cyclictest0-21swapper/409:39:094
101019945835,3cyclictest0-21swapper/210:57:082
1010399457117,338cyclictest0-21swapper/412:26:594
101029945734,256cyclictest0-21swapper/312:35:033
1010299457158,126cyclictest121rcu_preempt08:24:043
1010099457118,337cyclictest27761-21kworker/u16:010:34:391
101059945673,381cyclictest0-21swapper/610:23:096
1010399456412,42cyclictest481ktimersoftd/410:00:264
101019945634,218cyclictest0-21swapper/208:22:062
101009945634,84cyclictest0-21swapper/111:16:281
101009945634,84cyclictest0-21swapper/111:16:281
1010099456118,254cyclictest10097-21cyclictest08:23:251
101069945568,339cyclictest0-21swapper/712:49:557
101069945533,255cyclictest23157-21awk12:35:307
101009945574,84cyclictest0-21swapper/112:48:331
100999945534,255cyclictest0-21swapper/011:13:440
101009945433,42cyclictest26477-21idleruntime-cro10:40:001
1010699453369,3cyclictest721ktimersoftd/711:50:247
101069945330,257cyclictest0-21swapper/711:34:067
100999945332,2cyclictest22948-21runrttasks08:23:500
101069945230,256cyclictest0-21swapper/711:56:557
101049945231,2cyclictest29498-21ssh12:20:345
101039945230,84cyclictest0-21swapper/412:11:114
1010299452369,3cyclictest391rcuc/310:15:213
1010299452112,338cyclictest0-21swapper/310:13:453
101009945272,84cyclictest14672-21apt09:40:131
1010499451110,338cyclictest0-21swapper/511:50:235
101029945129,255cyclictest0-21swapper/311:58:363
101019945170,42cyclictest0-21swapper/210:22:532
1010399450108,339cyclictest0-21swapper/410:15:404
101069944927,255cyclictest0-21swapper/711:28:077
100999944926,211cyclictest0-21swapper/009:57:300
1009999449108,253cyclictest10097-21cyclictest12:08:410
1009999449108,253cyclictest10097-21cyclictest12:08:410
101059944864,42cyclictest0-21swapper/610:13:266
101009944766,84cyclictest0-21swapper/109:39:171
1010199446104,339cyclictest0-21swapper/210:15:402
101049944523,3cyclictest0-21swapper/512:35:345
101029944520,126cyclictest0-21swapper/312:26:243
101069944417,211cyclictest0-21swapper/711:00:017
101049944321,256cyclictest0-21swapper/510:57:085
1010399443148,169cyclictest121rcu_preempt12:35:264
101039944221,2cyclictest0-21swapper/412:49:194
101019944262,127cyclictest0-21swapper/211:50:402
101009944263,253cyclictest0-21swapper/110:00:171
100999944019,210cyclictest21905-21if_eth010:00:200
101049943916,256cyclictest0-21swapper/508:23:495
100999943996,340cyclictest0-21swapper/010:15:400
101039943816,86cyclictest0-21swapper/409:40:124
1010099438143,211cyclictest0-21swapper/111:48:021
101059943716,337cyclictest0-21swapper/612:20:066
101009943758,84cyclictest0-21swapper/112:20:211
101049943614,2cyclictest0-21swapper/510:23:495
101019943695,338cyclictest0-21swapper/207:58:542
101009943610,126cyclictest0-21swapper/112:08:531
101009943610,126cyclictest0-21swapper/112:08:531
101049943511,84cyclictest0-21swapper/509:40:135
100999943497,126cyclictest0-21swapper/012:35:050
100999943450,211cyclictest29302-21taskset11:58:400
100999943391,171cyclictest0-21swapper/011:49:380
100999942847,84cyclictest121rcu_preempt12:02:320
10103994270,211cyclictest49-21ksoftirqd/411:57:514
101049942645,84cyclictest0-21swapper/510:00:055
10100994268,289cyclictest0-21swapper/112:26:101
1009999426126,126cyclictest9-21ksoftirqd/012:49:000
101029942540,211cyclictest21170-21/usr/sbin/munin11:00:173
101039942441,218cyclictest0-21swapper/411:13:314
101069942383,338cyclictest0-21swapper/707:58:197
101059942180,84cyclictest0-21swapper/608:25:076
101049942181,337cyclictest0-21swapper/507:59:485
101049941939,3cyclictest0-21swapper/510:14:595
101039941982,84cyclictest0-21swapper/411:48:144
101019941980,84cyclictest0-21swapper/210:25:192
1010199419120,126cyclictest121rcu_preempt12:48:212
1010699418118,127cyclictest0-21swapper/712:26:507
101009941879,84cyclictest0-21swapper/110:15:391
101019941776,338cyclictest0-21swapper/210:13:042
100999941536,127cyclictest21168-21ssh11:00:170
101059941474,85cyclictest0-21swapper/611:13:546
1009999414115,126cyclictest0-21swapper/012:26:100
101049941275,253cyclictest0-21swapper/508:25:065
101019941270,211cyclictest21772-21hddtemp_smartct10:00:182
101029941131,296cyclictest0-21swapper/308:25:083
101049941069,338cyclictest0-21swapper/510:25:215
1009999410371,36cyclictest111rcuc/010:25:240
101049940929,3cyclictest0-21swapper/510:15:385
101049940867,338cyclictest0-21swapper/511:00:185
1010399408113,211cyclictest0-21swapper/411:00:184
101009940828,211cyclictest0-21swapper/107:57:311
101069940630,121cyclictest0-21swapper/710:25:217
101039940667,84cyclictest0-21swapper/410:25:054
101059940323,257cyclictest0-21swapper/612:35:346
101019940263,84cyclictest0-21swapper/208:25:072
101039939860,84cyclictest0-21swapper/408:25:084
101059939113,246cyclictest0-21swapper/610:25:216
100999938788,168cyclictest14675-21ssh09:40:140
10101993867,84cyclictest0-21swapper/209:40:102
10104993820,3cyclictest0-21swapper/511:13:295
101049938041,84cyclictest0-21swapper/512:27:115
101069937938,126cyclictest0-21swapper/709:40:047
101029937638,172cyclictest0-21swapper/311:35:073
101069937435,84cyclictest0-21swapper/710:00:087
101069937335,171cyclictest0-21swapper/708:00:077
1010299370118,120cyclictest41-21ksoftirqd/308:00:043
101069936829,172cyclictest0-21swapper/711:35:077
101049936629,2cyclictest0-21swapper/508:00:075
101029936525,338cyclictest0-21swapper/309:40:103
1010599360104,253cyclictest0-21swapper/608:00:046
101009935257,211cyclictest0-21swapper/111:35:071
10100993479,126cyclictest0-21swapper/108:00:041
101019934444,211cyclictest0-21swapper/211:35:152
101049933737,83cyclictest57-21ksoftirqd/511:35:085
101019933237,3cyclictest0-21swapper/208:00:112
1010399329119,130cyclictest17726-1diskmemload11:35:134
100999932670,126cyclictest131rcu_sched08:25:070
101009932269,84cyclictest0-21swapper/108:25:061
101069931723,210cyclictest0-21swapper/708:25:077
1009999313230,81cyclictest101ktimersoftd/008:00:070
1010399288118,168cyclictest0-21swapper/408:00:044
943128961,24sleep40-21swapper/407:06:364
952328554,27sleep30-21swapper/307:07:563
940628452,28sleep60-21swapper/607:06:146
945528342,37sleep10-21swapper/107:06:571
938728351,28sleep70-21swapper/707:05:597
934928250,28sleep50-21swapper/507:05:255
965528049,28sleep20-21swapper/207:09:472
941827947,28sleep00-21swapper/007:06:240
293472760,1sleep30-21swapper/309:30:203
46692690,0sleep40-21swapper/409:19:164
46692690,0sleep40-21swapper/409:19:164
285302550,0sleep60-21swapper/609:46:136
10105992928,0cyclictest0-21swapper/608:37:586
10102992910,18cyclictest0-21swapper/307:54:433
10101992928,0cyclictest0-21swapper/209:06:312
10101992910,18cyclictest0-21swapper/207:31:282
10100992910,18cyclictest0-21swapper/109:06:271
10106992810,18cyclictest0-21swapper/707:14:097
10105992828,0cyclictest0-21swapper/607:14:066
10105992826,1cyclictest23509-21ssh09:28:026
10105992826,1cyclictest0-21swapper/609:06:016
10105992826,1cyclictest0-21swapper/607:38:026
10105992810,17cyclictest0-21swapper/609:16:086
10105992810,17cyclictest0-21swapper/609:16:086
10105992810,17cyclictest0-21swapper/607:30:576
10105992810,0cyclictest0-21swapper/607:18:176
10103992810,17cyclictest0-21swapper/409:27:524
10102992828,0cyclictest0-21swapper/307:14:073
10102992810,18cyclictest0-21swapper/309:28:303
10102992810,18cyclictest0-21swapper/309:06:203
10102992810,18cyclictest0-21swapper/308:47:223
10102992810,18cyclictest0-21swapper/308:38:253
10102992810,0cyclictest0-21swapper/309:16:453
10102992810,0cyclictest0-21swapper/309:16:453
10101992827,0cyclictest0-21swapper/209:28:022
10100992810,17cyclictest0-21swapper/109:16:041
10100992810,17cyclictest0-21swapper/109:16:031
10100992810,17cyclictest0-21swapper/108:11:281
10099992810,18cyclictest0-21swapper/009:16:140
10099992810,18cyclictest0-21swapper/009:16:140
10106992727,0cyclictest0-21swapper/709:28:047
10106992727,0cyclictest0-21swapper/709:16:067
10106992727,0cyclictest0-21swapper/709:16:057
10106992710,17cyclictest0-21swapper/709:06:397
10106992710,17cyclictest0-21swapper/708:56:477
10106992710,17cyclictest0-21swapper/708:11:517
10106992710,17cyclictest0-21swapper/707:38:027
10106992710,17cyclictest0-21swapper/707:30:587
10106992710,17cyclictest0-21swapper/707:18:327
10106992710,0cyclictest0-21swapper/708:37:527
10105992726,1cyclictest0-21swapper/608:47:036
10105992726,0cyclictest0-21swapper/608:56:466
10105992710,17cyclictest0-21swapper/609:54:546
10105992710,17cyclictest0-21swapper/608:11:246
10105992710,17cyclictest0-21swapper/607:54:576
10105992710,17cyclictest0-21swapper/607:23:556
10105992710,0cyclictest0-21swapper/607:45:556
10104992727,0cyclictest0-21swapper/508:56:275
10104992727,0cyclictest0-21swapper/507:18:125
10104992710,17cyclictest0-21swapper/509:54:565
10104992710,17cyclictest0-21swapper/509:27:525
10104992710,17cyclictest0-21swapper/509:16:045
10104992710,17cyclictest0-21swapper/509:16:035
10104992710,17cyclictest0-21swapper/508:37:555
10104992710,17cyclictest0-21swapper/508:11:225
10104992710,17cyclictest0-21swapper/507:14:025
10104992710,0cyclictest0-21swapper/509:06:025
10104992710,0cyclictest0-21swapper/508:47:255
10104992710,0cyclictest0-21swapper/507:54:455
10104992710,0cyclictest0-21swapper/507:45:555
10104992710,0cyclictest0-21swapper/507:38:055
10104992710,0cyclictest0-21swapper/507:24:035
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional