You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 17:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot2.osadl.org (updated Thu May 14, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
842177991473,101cyclictest16-21ksoftirqd/008:45:270
842178991453,102cyclictest31-21ksoftirqd/109:45:181
842177991355,115cyclictest16-21ksoftirqd/009:35:160
842177991355,115cyclictest16-21ksoftirqd/009:35:160
842177991326,92cyclictest16-21ksoftirqd/011:11:210
8421779913125,69cyclictest21-21rcuc/008:55:180
84217999127110,10cyclictest80-21hwrng09:51:192
84217999127110,10cyclictest80-21hwrng09:51:192
84218099124110,4cyclictest80-21hwrng12:12:383
84217899124107,12cyclictest896984-21ssh09:41:021
84217899124107,12cyclictest896984-21ssh09:41:021
84217799124108,11cyclictest80-21hwrng09:55:250
84218099120109,6cyclictest80-21hwrng12:25:573
842178991205,86cyclictest912189-21apt-get10:05:261
84218099116100,10cyclictest80-21hwrng07:16:423
84218099115105,7cyclictest80-21hwrng08:43:443
84218099115105,7cyclictest80-21hwrng08:43:443
84218099115104,9cyclictest80-21hwrng08:10:583
8421799911498,6cyclictest80-21hwrng09:41:052
8421799911498,6cyclictest80-21hwrng09:41:052
84218099113104,6cyclictest80-21hwrng08:02:473
8421789911250,45cyclictest301ktimers/108:05:161
84218099111102,6cyclictest80-21hwrng09:01:093
8421789911118,9cyclictest0-21swapper/112:23:421
8421789911118,9cyclictest0-21swapper/112:23:421
84218099110102,5cyclictest80-21hwrng08:36:343
84218099110101,4cyclictest80-21hwrng08:49:533
84217899110100,6cyclictest80-21hwrng10:00:321
84217899110100,6cyclictest80-21hwrng10:00:321
84217999109100,6cyclictest80-21hwrng10:50:432
84218099108101,4cyclictest80-21hwrng07:22:503
84217999108102,4cyclictest80-21hwrng09:13:262
84217999108101,4cyclictest80-21hwrng10:04:382
84217999108101,4cyclictest80-21hwrng10:04:382
8421789910895,10cyclictest80-21hwrng09:16:301
8421789910698,5cyclictest80-21hwrng07:52:321
8421789910694,8cyclictest80-21hwrng09:38:001
8421789910694,8cyclictest80-21hwrng09:38:001
84217899106100,4cyclictest301ktimers/108:31:561
842180991052,67cyclictest0-21swapper/309:40:473
842180991052,67cyclictest0-21swapper/309:40:473
8421799910590,11cyclictest80-21hwrng09:24:422
8421799910590,11cyclictest80-21hwrng09:24:422
8421799910589,5cyclictest80-21hwrng08:07:542
8421789910444,57cyclictest301ktimers/108:10:301
8421799910384,13cyclictest80-21hwrng08:01:452
8421789910386,13cyclictest80-21hwrng07:45:221
8421779910328,65cyclictest171ktimers/009:00:170
8421799910089,8cyclictest80-21hwrng07:41:162
842178999985,10cyclictest80-21hwrng07:20:471
842178999936,54cyclictest0-21swapper/112:00:561
842178999936,54cyclictest0-21swapper/112:00:561
842179999886,9cyclictest80-21hwrng11:12:132
842177999875,18cyclictest0-21swapper/007:40:470
842177999745,48cyclictest171ktimers/009:45:150
842179999688,5cyclictest80-21hwrng08:30:252
842179999688,5cyclictest80-21hwrng08:30:252
842178999680,5cyclictest80-21hwrng10:55:501
842178999665,24cyclictest0-21swapper/109:15:021
842179999488,4cyclictest80-21hwrng09:46:122
842178999465,25cyclictest0-21swapper/110:00:031
842180999386,4cyclictest80-21hwrng10:57:533
842179999385,5cyclictest80-21hwrng09:35:582
842179999385,5cyclictest80-21hwrng09:35:582
842177999329,61cyclictest0-21swapper/008:10:120
842179999260,28cyclictest80-21hwrng10:05:392
84217799928,19cyclictest879172-21diskmemload09:15:240
842180999180,8cyclictest80-21hwrng11:41:553
842178999141,10cyclictest301ktimers/112:25:421
842178999129,16cyclictest932902-21kworker/u16:11+rpciod11:40:111
842177999129,51cyclictest171ktimers/008:26:030
842177999129,51cyclictest171ktimers/008:26:030
842177999123,47cyclictest894817-21kworker/u16:1+xprtiod09:40:160
842177999123,47cyclictest894817-21kworker/u16:1+xprtiod09:40:160
842178999079,9cyclictest890184-21sed09:31:091
842178999044,41cyclictest902792-21ssh09:50:141
842178999044,41cyclictest902792-21ssh09:50:141
842177999069,18cyclictest0-21swapper/007:36:250
842177999069,18cyclictest0-21swapper/007:36:250
842177999024,41cyclictest881676-21kworker/u16:6+rpciod09:20:150
842177999024,41cyclictest881676-21kworker/u16:6+rpciod09:20:150
84217799898,31cyclictest919344-21ps10:46:590
842180998861,22cyclictest0-21swapper/307:40:473
842179998874,8cyclictest80-21hwrng07:35:082
842179998874,8cyclictest80-21hwrng07:35:082
842178998838,10cyclictest0-21swapper/111:21:061
842177998825,49cyclictest0-21swapper/011:20:350
842179998738,17cyclictest894817-21kworker/u16:1+xprtiod09:55:132
84217899875,40cyclictest0-21swapper/108:41:171
84217899875,40cyclictest0-21swapper/108:41:171
842177998766,15cyclictest171ktimers/010:02:430
842177998766,15cyclictest171ktimers/010:02:430
84217799873,64cyclictest913103-21ntpq10:05:410
842180998623,43cyclictest471643-21kworker/u16:8+rpciod08:10:023
84217799866,9cyclictest0-21swapper/012:01:150
84217799866,9cyclictest0-21swapper/012:01:150
84217899852,48cyclictest879339-21ssh09:10:021
842177998555,26cyclictest947158-21sendmail-msp12:23:430
842177998555,26cyclictest947158-21sendmail-msp12:23:430
842180998475,6cyclictest80-21hwrng07:27:583
842180998475,6cyclictest80-21hwrng07:27:583
842178998433,40cyclictest0-21swapper/109:20:411
842178998433,40cyclictest0-21swapper/109:20:411
84217899841,48cyclictest849046-21cat07:36:141
84217899841,48cyclictest849046-21cat07:36:141
842177998477,5cyclictest80-21hwrng12:09:340
842177998461,18cyclictest0-21swapper/007:36:140
842177998461,18cyclictest0-21swapper/007:36:140
84217899831,13cyclictest878135-21switchtime09:01:591
842177998375,6cyclictest171ktimers/011:55:220
842177998375,6cyclictest171ktimers/011:55:220
84218099825,53cyclictest893317-21ssh09:35:533
84218099825,53cyclictest893317-21ssh09:35:533
842179998268,11cyclictest80-21hwrng07:10:332
842178998224,27cyclictest847507-21ntpq07:25:561
842178998224,27cyclictest847507-21ntpq07:25:561
84217899822,12cyclictest931636-21aten_r8power_vo11:30:301
84217799822,5cyclictest936152-21aten_r8power_vo11:52:190
84217799821,33cyclictest922987-21ps10:56:040
842180998162,15cyclictest461ktimers/310:46:413
842178998174,4cyclictest80-21hwrng11:11:111
84217799816,47cyclictest879470-21/usr/sbin/munin09:10:370
84217799813,10cyclictest947499-21latency_hist12:25:010
842177998121,56cyclictest950474-21ntpq12:31:050
84217799811,75cyclictest871082-21cpu08:41:200
84217799811,75cyclictest871082-21cpu08:41:200
84217799811,32cyclictest934373-21ps11:37:560
84217799811,32cyclictest934373-21ps11:37:560
84217799811,24cyclictest874289-21/usr/sbin/munin08:51:580
842179998069,6cyclictest80-21hwrng11:15:172
842179998069,6cyclictest80-21hwrng11:15:172
842179998067,4cyclictest80-21hwrng12:30:022
842179998066,11cyclictest0-21swapper/209:15:142
842179998058,13cyclictest0-21swapper/208:41:262
842179998058,13cyclictest0-21swapper/208:41:262
842179998037,38cyclictest0-21swapper/208:40:152
842177998018,50cyclictest838334-21kworker/u16:17+rpciod07:12:390
84217799801,35cyclictest924621-21/usr/sbin/munin11:05:290
84217799801,30cyclictest902745-21/usr/sbin/munin09:50:290
84217799801,30cyclictest902745-21/usr/sbin/munin09:50:290
842180997969,7cyclictest0-21swapper/311:40:023
842180997969,7cyclictest0-21swapper/311:40:023
842180997955,20cyclictest461ktimers/310:05:253
842179997971,5cyclictest80-21hwrng12:32:052
842178997924,20cyclictest850937-21cat07:40:321
842178997924,20cyclictest850937-21cat07:40:321
84217899792,36cyclictest915745-21sshd-auth10:11:411
84217899792,36cyclictest915745-21sshd-auth10:11:411
842177997924,45cyclictest1-21systemd10:20:270
842180997872,3cyclictest887346-21ntpq09:20:533
842180997872,3cyclictest887346-21ntpq09:20:533
842180997854,18cyclictest0-21swapper/307:52:163
842180997852,20cyclictest0-21swapper/309:45:363
842179997870,5cyclictest80-21hwrng08:32:282
842178997867,6cyclictest860132-21latency_hist08:05:011
842178997850,11cyclictest301ktimers/112:35:161
842178997845,25cyclictest0-21swapper/107:40:551
842178997838,6cyclictest0-21swapper/112:23:451
842178997817,28cyclictest950946-21users12:31:141
842177997819,54cyclictest0-21swapper/012:25:130
84217799781,30cyclictest929586-21apt-get11:25:120
84217799781,30cyclictest929586-21apt-get11:25:120
842177997811,58cyclictest0-21swapper/007:20:020
84217799781,13cyclictest870783-21sh08:40:150
84218099773,68cyclictest909293-21grep10:00:393
84218099773,68cyclictest909293-21grep10:00:393
842179997757,17cyclictest0-21swapper/212:01:092
842179997757,17cyclictest0-21swapper/212:01:092
842179997741,24cyclictest381ktimers/210:55:532
84217999772,60cyclictest854338-21kworker/u16:16+rpciod08:00:162
842178997744,21cyclictest935994-21kworker/u16:6+nfsiod12:01:131
842178997744,21cyclictest935994-21kworker/u16:6+nfsiod12:01:131
842177997734,38cyclictest932303-21sleep11:30:550
84217799771,33cyclictest853574-21/usr/sbin/munin07:45:390
842180997653,19cyclictest0-21swapper/310:00:013
842179997661,9cyclictest0-21swapper/207:20:112
842177997654,13cyclictest171ktimers/008:00:320
842177997628,45cyclictest890364-21users09:31:110
84218099751,68cyclictest939509-21store12:00:573
84218099751,68cyclictest939509-21store12:00:573
842178997529,16cyclictest0-21swapper/112:10:361
842178997529,10cyclictest934979-21sendmail-msp11:40:021
842178997529,10cyclictest934979-21sendmail-msp11:40:021
84217799759,3cyclictest9950irq/131-8000000.ethernet-tx208:05:110
84217799752,17cyclictest927563-21latency_hist11:20:010
84217799752,17cyclictest927563-21latency_hist11:20:010
84217799751,71cyclictest857623-21ntpq07:57:460
84217799751,17cyclictest847477-21sh07:25:530
84217799751,17cyclictest847477-21sh07:25:530
842177997424,46cyclictest943822-21/usr/sbin/munin12:10:360
84217799742,10cyclictest845797-21ps07:21:020
842180997340,27cyclictest1-21systemd08:55:593
842178997327,9cyclictest0-21swapper/111:27:001
842178997327,9cyclictest0-21swapper/111:27:001
84217799731,29cyclictest869265-21/usr/sbin/munin08:32:200
84217799730,18cyclictest856041-21/usr/sbin/munin07:52:430
84218099724,61cyclictest47-21ksoftirqd/309:15:343
842179997258,5cyclictest80-21hwrng11:27:342
842179997258,5cyclictest80-21hwrng11:27:342
842178997236,3cyclictest858298-21sendmail-msp08:00:181
84218099711,55cyclictest905560-21cat09:55:033
84218099711,55cyclictest905560-21cat09:55:033
842178997140,25cyclictest0-21swapper/110:46:321
842180997036,31cyclictest0-21swapper/311:35:013
842179997054,6cyclictest80-21hwrng10:19:592
842179997042,19cyclictest0-21swapper/208:10:132
842179997030,33cyclictest37-21rcuc/211:35:522
842179997030,33cyclictest37-21rcuc/211:35:522
84217799708,5cyclictest0-21swapper/010:51:060
842178996954,10cyclictest0-21swapper/107:20:001
84217799691,22cyclictest951725-21/usr/sbin/munin12:35:370
84218099683,36cyclictest461ktimers/309:10:483
842179996829,34cyclictest0-21swapper/209:00:302
842178996822,12cyclictest301ktimers/107:10:151
84217799681,62cyclictest0-21swapper/009:10:000
842180996754,8cyclictest80-21hwrng12:23:543
842179996759,5cyclictest947448-21kworker/u16:8+rpciod12:40:022
842178996720,26cyclictest29-21rcuc/108:55:591
842180996633,21cyclictest461ktimers/311:11:243
842179996642,12cyclictest0-21swapper/207:20:002
84217799661,2cyclictest0-21swapper/011:05:050
842180996536,18cyclictest461ktimers/307:57:433
84218099651,48cyclictest842176-21cyclictest10:50:453
842179996557,5cyclictest80-21hwrng11:50:062
842179996550,12cyclictest80-21hwrng12:16:442
842179996550,12cyclictest80-21hwrng12:16:442
842180996429,28cyclictest647-21lldpd07:36:303
842180996429,28cyclictest647-21lldpd07:36:303
842180996426,26cyclictest842176-21cyclictest07:45:503
842179996456,6cyclictest80-21hwrng10:12:492
842179996456,6cyclictest80-21hwrng10:12:492
842179996449,10cyclictest0-21swapper/212:10:292
842179996427,24cyclictest939644-21latency_hist12:00:592
842179996427,24cyclictest939644-21latency_hist12:00:592
842180996356,5cyclictest461ktimers/309:30:573
842180996338,20cyclictest842176-21cyclictest11:25:153
842180996338,20cyclictest842176-21cyclictest11:25:153
842179996355,4cyclictest80-21hwrng10:46:372
842179996354,7cyclictest80-21hwrng11:33:432
84217999634,50cyclictest891394-21sshd-auth09:33:322
842179996334,13cyclictest381ktimers/207:51:522
842180996243,17cyclictest461ktimers/311:05:233
842180996237,17cyclictest461ktimers/312:30:223
842179996237,17cyclictest0-21swapper/207:36:262
842179996237,17cyclictest0-21swapper/207:36:262
842179996234,20cyclictest37-21rcuc/207:25:312
842179996234,20cyclictest37-21rcuc/207:25:312
842178996231,23cyclictest469-21dbus-broker10:34:231
84217799623,33cyclictest916292-21sshd-auth10:17:440
84217799623,33cyclictest916292-21sshd-auth10:17:440
842180996137,17cyclictest0-21swapper/308:26:083
842180996137,17cyclictest0-21swapper/308:26:083
84218099611,51cyclictest0-21swapper/308:31:513
842179996146,12cyclictest381ktimers/211:20:152
84218099603,26cyclictest45-21rcuc/312:10:023
842179996047,9cyclictest0-21swapper/212:05:122
84217899601,42cyclictest921122-21ntpq10:51:291
842180995941,12cyclictest0-21swapper/307:15:023
842180995940,17cyclictest0-21swapper/311:20:103
842180995937,16cyclictest0-21swapper/312:16:053
842180995937,16cyclictest0-21swapper/312:16:053
842180995845,11cyclictest461ktimers/308:50:163
842179995827,14cyclictest875962-21ntpq08:55:562
842180995734,17cyclictest916291-21sshd-session10:17:443
842180995734,17cyclictest916291-21sshd-session10:17:443
842179995743,5cyclictest80-21hwrng09:07:172
842179995727,27cyclictest853657-21ntpq07:45:442
84217799575,16cyclictest842363-21cat07:10:030
842180995642,6cyclictest879175-21munin-run09:10:013
842180995636,14cyclictest461ktimers/312:01:423
842180995636,14cyclictest461ktimers/312:01:423
842179995637,16cyclictest0-21swapper/212:23:562
842179995633,18cyclictest0-21swapper/208:52:022
842178995632,17cyclictest301ktimers/111:11:571
842178995628,24cyclictest874111-21ntpq08:51:441
842180995438,9cyclictest0-21swapper/312:40:033
842180995431,16cyclictest0-21swapper/307:36:133
842180995431,16cyclictest0-21swapper/307:36:133
842178995425,23cyclictest867810-21/usr/sbin/munin08:26:481
842178995425,23cyclictest867810-21/usr/sbin/munin08:26:481
842178995334,16cyclictest0-21swapper/111:05:051
84217899532,36cyclictest870777-21cat08:40:151
84217799532,13cyclictest842215-21latency_hist07:10:020
842180995236,13cyclictest0-21swapper/311:20:033
842180995134,11cyclictest0-21swapper/311:03:463
842178994941,6cyclictest0-21swapper/112:10:021
842180994829,15cyclictest461ktimers/310:46:083
842178994826,10cyclictest0-21swapper/111:20:021
842178994826,10cyclictest0-21swapper/111:20:021
842180994734,7cyclictest0-21swapper/311:20:013
84217799479,33cyclictest0-21swapper/008:25:500
84217999463,35cyclictest39-21ksoftirqd/208:45:302
842179994433,8cyclictest0-21swapper/211:11:112
842180994331,6cyclictest0-21swapper/307:10:033
842180994331,6cyclictest0-21swapper/307:10:033
84217999411,36cyclictest919853-21kworker/u16:14+rpciod11:05:042
842178994119,16cyclictest872705-21apt08:45:181
842179994025,12cyclictest0-21swapper/207:10:022
842179994025,12cyclictest0-21swapper/207:10:022
842178993830,4cyclictest842301-21latency_hist07:10:021
842178993830,4cyclictest842301-21latency_hist07:10:021
842180993421,6cyclictest866133-21latency_hist08:25:503
84217999311,27cyclictest866571-21cat08:25:502
842178992618,4cyclictest866174-21apt-get08:25:501
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional