You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 00:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Wed Jun 17, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1612250991525,116cyclictest1745193-21ssh11:15:011
1612250991525,116cyclictest1745193-21ssh11:15:011
161225099152141,9cyclictest0-21swapper/109:30:461
161225099150138,8cyclictest81-21hwrng08:41:121
16122529914510,105cyclictest1748561-21sendmail-msp11:20:373
1612249991391,61cyclictest1757089-21ps11:31:070
1612249991391,61cyclictest1757089-21ps11:31:070
161225299138120,14cyclictest81-21hwrng09:15:003
161225199137122,11cyclictest81-21hwrng11:33:142
161225199137122,11cyclictest81-21hwrng11:33:142
161225099135128,5cyclictest10650irq/205-8000000.ethernet-rx010:55:481
1612249991321,35cyclictest1625187-21kworker/u16:16+rpciod08:00:010
1612249991321,35cyclictest1625187-21kworker/u16:16+rpciod08:00:010
161225099131112,10cyclictest81-21hwrng11:07:381
161225199129113,12cyclictest81-21hwrng07:17:142
161225199129113,12cyclictest81-21hwrng07:17:142
161225199128120,5cyclictest81-21hwrng11:59:512
161224999128110,13cyclictest81-21hwrng09:40:360
16122499912713,78cyclictest1612248-21cyclictest10:45:160
16122509912644,76cyclictest0-21swapper/109:25:361
161225299125109,12cyclictest81-21hwrng10:09:163
1612250991255,57cyclictest1706415-21sendmail-msp10:20:391
1612250991255,57cyclictest1706415-21sendmail-msp10:20:391
1612252991224,94cyclictest0-21swapper/311:15:013
1612252991224,94cyclictest0-21swapper/311:15:013
161225299122113,5cyclictest81-21hwrng08:43:153
161225299122112,6cyclictest81-21hwrng11:26:043
161225299122106,12cyclictest81-21hwrng10:36:553
161225299122106,12cyclictest81-21hwrng10:36:553
161225099122113,6cyclictest81-21hwrng10:41:011
1612249991221,79cyclictest0-21swapper/011:10:150
1612249991221,79cyclictest0-21swapper/011:10:150
161225199121113,5cyclictest81-21hwrng09:24:132
161225199121113,5cyclictest81-21hwrng09:24:132
161225199121112,6cyclictest81-21hwrng10:33:512
1612249991211,11cyclictest1684216-21kworker/u16:1+rpciod10:00:000
161225299120111,6cyclictest81-21hwrng08:46:193
161225199120105,5cyclictest81-21hwrng07:43:522
161225099120111,6cyclictest81-21hwrng11:32:131
161225099120111,6cyclictest81-21hwrng11:32:131
161224999120101,7cyclictest81-21hwrng11:05:350
161225099119110,6cyclictest81-21hwrng11:03:321
161225199118111,5cyclictest81-21hwrng09:49:492
16122499911877,17cyclictest1612248-21cyclictest11:35:560
161225299117107,6cyclictest81-21hwrng10:45:063
16122529911654,58cyclictest0-21swapper/309:56:113
161225199116107,6cyclictest81-21hwrng11:39:232
1612249991161,45cyclictest0-21swapper/011:25:000
161225199115105,7cyclictest81-21hwrng11:52:412
161225199115102,11cyclictest81-21hwrng08:54:312
161225199114106,6cyclictest81-21hwrng08:49:242
161225299113104,6cyclictest81-21hwrng09:50:503
161225299113104,6cyclictest81-21hwrng09:05:473
161225199113105,5cyclictest81-21hwrng07:21:202
161225199113100,7cyclictest81-21hwrng08:35:042
161225199113100,7cyclictest81-21hwrng08:35:042
161225099113105,5cyclictest81-21hwrng08:05:221
161225099113104,5cyclictest81-21hwrng07:19:171
161225099113104,5cyclictest81-21hwrng07:19:171
1612249991131,39cyclictest1763689-21/usr/sbin/munin11:41:030
16122519911197,5cyclictest81-21hwrng08:31:592
161225099111103,5cyclictest81-21hwrng12:29:331
161225099111103,5cyclictest81-21hwrng12:29:331
16122529911033,23cyclictest0-21swapper/311:40:103
16122519911095,12cyclictest81-21hwrng11:24:012
16122519911095,12cyclictest81-21hwrng08:08:262
16122509911041,28cyclictest1777178-21hostname12:00:351
16122509911041,28cyclictest1777178-21hostname12:00:351
16122529910999,7cyclictest81-21hwrng08:24:493
16122529910960,11cyclictest0-21swapper/311:15:243
161225299109100,4cyclictest81-21hwrng10:20:323
161225299109100,4cyclictest81-21hwrng10:20:323
16122519910899,6cyclictest81-21hwrng07:55:072
16122519910899,6cyclictest81-21hwrng07:55:072
16122519910898,7cyclictest81-21hwrng08:26:522
16122519910879,22cyclictest0-21swapper/211:01:072
16122529910754,48cyclictest0-21swapper/309:00:013
16122529910754,48cyclictest0-21swapper/309:00:013
16122529910698,5cyclictest81-21hwrng12:38:463
16122529910655,40cyclictest0-21swapper/312:30:233
16122519910699,4cyclictest81-21hwrng08:21:452
16122509910646,16cyclictest0-21swapper/108:50:011
16122509910597,5cyclictest81-21hwrng08:11:301
16122529910493,6cyclictest81-21hwrng12:20:203
16122529910489,8cyclictest81-21hwrng09:35:283
1612252991042,4cyclictest0-21swapper/310:00:533
16122499910498,4cyclictest81-21hwrng10:52:160
16122499910387,9cyclictest81-21hwrng11:01:290
16122499910342,52cyclictest0-21swapper/007:20:160
1612252991024,20cyclictest1781529-21ntpq12:06:033
16122519910290,9cyclictest81-21hwrng11:43:282
16122509910256,41cyclictest0-21swapper/111:40:171
16122509910252,12cyclictest0-21swapper/112:30:161
16122499910291,5cyclictest81-21hwrng12:04:590
16122499910291,5cyclictest81-21hwrng12:04:590
16122529910193,5cyclictest81-21hwrng07:32:363
16122529910187,6cyclictest81-21hwrng08:15:363
16122519910186,12cyclictest81-21hwrng08:14:352
16122499910192,5cyclictest81-21hwrng12:11:070
16122499910150,48cyclictest10650irq/205-8000000.ethernet-rx010:40:130
16122529910091,6cyclictest10650irq/205-8000000.ethernet-rx010:26:583
16122529910040,53cyclictest45-21rcuc/309:45:203
16122529910030,24cyclictest1265263-21kworker/u16:6+rpciod08:00:023
16122509910051,45cyclictest0-21swapper/111:20:091
16122509910051,44cyclictest0-21swapper/107:35:391
16122499910042,52cyclictest0-21swapper/012:30:160
1612251999991,5cyclictest81-21hwrng12:21:222
161224999996,28cyclictest1706653-21sleep10:20:060
161224999996,28cyclictest1706653-21sleep10:20:060
1612249999955,41cyclictest171ktimers/012:35:580
1612249999938,13cyclictest0-21swapper/012:30:010
1612249999938,13cyclictest0-21swapper/012:30:010
161224999993,54cyclictest1661886-21ntpq09:15:410
1612250999893,3cyclictest10650irq/205-8000000.ethernet-rx010:45:301
1612250999890,4cyclictest81-21hwrng10:16:261
1612249999887,6cyclictest81-21hwrng07:51:020
1612249999843,49cyclictest1745378-21ssh11:15:160
161224999981,55cyclictest1686649-21ssh09:50:510
1612251999787,8cyclictest81-21hwrng12:19:192
1612251999787,8cyclictest81-21hwrng12:19:192
1612250999788,6cyclictest81-21hwrng11:15:501
161225099972,70cyclictest1775027-21uptime11:56:131
1612249999741,44cyclictest0-21swapper/010:19:040
1612252999655,9cyclictest1720479-21sendmail-msp10:40:153
1612251999686,7cyclictest81-21hwrng08:18:402
1612250999656,4cyclictest10650irq/205-8000000.ethernet-rx010:25:261
1612250999656,29cyclictest0-21swapper/107:25:001
1612252999587,5cyclictest81-21hwrng12:17:163
1612252999587,5cyclictest81-21hwrng12:17:163
1612252999585,6cyclictest81-21hwrng07:26:273
1612252999522,37cyclictest1722977-21kworker/u16:20+xprtiod10:55:333
1612250999582,6cyclictest81-21hwrng08:36:051
1612250999582,6cyclictest81-21hwrng08:36:051
1612249999539,7cyclictest0-21swapper/011:45:550
1612249999538,49cyclictest0-21swapper/008:16:070
1612251999462,24cyclictest0-21swapper/212:00:242
1612251999462,24cyclictest0-21swapper/212:00:242
1612251999456,33cyclictest0-21swapper/209:40:192
1612249999484,6cyclictest81-21hwrng09:00:400
1612249999479,5cyclictest81-21hwrng10:56:220
1612249999438,45cyclictest0-21swapper/010:10:280
161224999942,40cyclictest1623514-21sendmail-msp07:40:150
1612252999379,11cyclictest81-21hwrng09:20:073
1612252999379,11cyclictest81-21hwrng09:20:073
1612249999342,44cyclictest0-21swapper/009:20:400
1612249999342,44cyclictest0-21swapper/009:20:400
1612252999284,5cyclictest81-21hwrng09:30:213
1612251999280,5cyclictest81-21hwrng08:56:342
1612251999280,5cyclictest81-21hwrng08:56:342
1612250999276,13cyclictest81-21hwrng09:56:591
1612249999236,16cyclictest0-21swapper/010:26:110
1612252999177,11cyclictest81-21hwrng12:10:063
161224999911,70cyclictest0-21swapper/010:30:440
1612252999067,5cyclictest81-21hwrng07:12:073
1612252999067,5cyclictest81-21hwrng07:12:073
1612249999080,5cyclictest81-21hwrng11:50:390
1612252998963,12cyclictest1767464-21ntp_states11:45:593
1612249998958,20cyclictest0-21swapper/012:15:560
1612249998958,20cyclictest0-21swapper/012:15:560
1612250998879,7cyclictest81-21hwrng07:50:001
1612250998879,7cyclictest81-21hwrng07:50:001
1612250998872,12cyclictest81-21hwrng07:27:281
1612250998868,13cyclictest0-21swapper/112:05:541
1612250998825,17cyclictest1595841-21kworker/u16:0+xprtiod08:55:091
1612250998825,17cyclictest1595841-21kworker/u16:0+xprtiod08:55:091
1612249998822,27cyclictest1765224-21kworker/u16:14+rpciod12:20:160
1612251998779,5cyclictest81-21hwrng07:36:412
1612251998767,14cyclictest0-21swapper/209:10:422
1612251998750,29cyclictest381ktimers/210:45:162
1612250998779,4cyclictest81-21hwrng08:00:151
161224999865,19cyclictest1781381-21ntpq12:05:520
1612249998639,9cyclictest0-21swapper/010:00:300
1612249998621,27cyclictest1648323-21diskstats08:45:340
161225299859,72cyclictest1714734-21ntpq10:30:513
1612252998562,20cyclictest461ktimers/308:25:123
1612251998569,5cyclictest1707258-21sh10:21:282
1612251998569,5cyclictest1707258-21sh10:21:282
1612249998577,5cyclictest81-21hwrng08:59:380
1612249998577,5cyclictest81-21hwrng08:59:380
1612249998533,14cyclictest0-21swapper/011:59:240
1612249998525,25cyclictest1639311-21/usr/sbin/munin08:20:440
1612249998524,25cyclictest1595841-21kworker/u16:0+xprtiod08:50:110
1612252998458,22cyclictest461ktimers/311:35:163
1612249998461,20cyclictest1666824-21kworker/u16:15+xprtiod09:30:460
1612252998366,13cyclictest81-21hwrng09:02:423
1612251998361,17cyclictest0-21swapper/210:40:292
1612251998354,23cyclictest0-21swapper/211:15:142
161224999834,65cyclictest1676041-21modprobe09:35:470
1612249998340,6cyclictest1682960-21missed_timers09:45:430
1612249998328,25cyclictest1753344-21ssh11:25:500
1612251998262,9cyclictest37-21rcuc/209:20:012
1612249998233,10cyclictest0-21swapper/008:40:500
161224999821,49cyclictest1720098-21sd-close10:39:070
161224999821,49cyclictest1720098-21sd-close10:39:070
1612251998173,6cyclictest81-21hwrng10:58:252
1612251998155,11cyclictest0-21swapper/208:00:332
1612251998152,20cyclictest381ktimers/209:00:262
1612251998143,18cyclictest0-21swapper/207:25:122
1612249998146,30cyclictest0-21swapper/007:10:340
1612249998146,30cyclictest0-21swapper/007:10:340
1612249998134,15cyclictest1625587-21/usr/sbin/munin07:45:360
1612249998134,15cyclictest1625587-21/usr/sbin/munin07:45:360
1612249998122,27cyclictest1658517-21ssh09:10:530
1612252998072,5cyclictest81-21hwrng11:56:473
1612249998036,20cyclictest171ktimers/008:10:150
1612251997943,20cyclictest0-21swapper/210:00:012
1612250997970,5cyclictest81-21hwrng07:40:471
1612250997960,15cyclictest0-21swapper/108:50:121
1612252997872,4cyclictest81-21hwrng08:33:013
1612252997854,22cyclictest1755842-21apt-get11:30:243
1612252997854,22cyclictest1755842-21apt-get11:30:243
1612250997869,6cyclictest81-21hwrng11:48:361
1612249997832,11cyclictest0-21swapper/009:05:350
1612251997757,16cyclictest1717224-21ssh10:35:122
1612251997757,16cyclictest1717224-21ssh10:35:122
1612251997740,15cyclictest0-21swapper/210:15:282
1612251997670,3cyclictest1669740-21unixbench_singl09:26:122
1612251997661,12cyclictest0-21swapper/212:30:002
1612251997661,12cyclictest0-21swapper/212:30:002
1612249997631,36cyclictest0-21swapper/008:00:340
1612252997520,40cyclictest0-21swapper/311:01:173
161225099758,60cyclictest1696162-21apt-get10:05:171
1612251997414,54cyclictest1799108-21sleep12:31:162
161225199732,64cyclictest1711848-21/usr/sbin/munin10:26:112
161225199731,32cyclictest1672574-21sh09:30:532
1612250997364,6cyclictest81-21hwrng09:46:441
1612250997359,11cyclictest1612248-21cyclictest10:10:341
1612249997331,8cyclictest0-21swapper/007:09:590
1612249997331,8cyclictest0-21swapper/007:09:590
1612249997329,18cyclictest1614613-21/usr/sbin/munin07:15:310
1612249997329,18cyclictest1614613-21/usr/sbin/munin07:15:310
1612251997266,4cyclictest381ktimers/209:36:062
1612249997232,34cyclictest171ktimers/007:26:190
1612252997143,22cyclictest0-21swapper/308:50:213
161225199719,57cyclictest1700334-21if_eth110:10:372
1612251997161,7cyclictest0-21swapper/209:50:532
1612251997160,7cyclictest381ktimers/212:10:252
1612251997152,17cyclictest37-21rcuc/211:10:272
1612251997152,17cyclictest37-21rcuc/211:10:272
1612250997160,8cyclictest10650irq/205-8000000.ethernet-rx010:35:141
1612250997160,8cyclictest10650irq/205-8000000.ethernet-rx010:35:141
1612250997151,13cyclictest0-21swapper/111:35:151
1612251997047,12cyclictest0-21swapper/210:05:002
1612250997031,36cyclictest0-21swapper/110:30:351
1612249997028,23cyclictest1697094-21ntpq10:05:490
1612251996953,13cyclictest381ktimers/208:40:132
1612251996929,33cyclictest1625977-21fschecks_time07:45:352
1612251996929,33cyclictest1625977-21fschecks_time07:45:352
161225299687,15cyclictest1780101-21latency_hist12:04:593
161225299687,15cyclictest1780101-21latency_hist12:04:593
1612251996849,10cyclictest0-21swapper/212:05:372
161225099689,39cyclictest10650irq/205-8000000.ethernet-rx009:15:471
1612250996831,17cyclictest19-21rcu_preempt07:55:221
1612250996831,17cyclictest19-21rcu_preempt07:55:221
1612249996828,7cyclictest10050irq/131-8000000.ethernet-tx209:29:280
1612252996751,5cyclictest81-21hwrng07:42:503
161225299673,49cyclictest0-21swapper/309:15:573
1612251996755,6cyclictest0-21swapper/207:11:012
1612251996755,6cyclictest0-21swapper/207:11:012
161225099673,51cyclictest1638705-21sshd-session08:20:141
1612250996720,34cyclictest301ktimers/107:15:001
1612250996720,34cyclictest301ktimers/107:15:001
161225299663,60cyclictest1728856-21ntp_states10:50:583
1612251996633,28cyclictest1802431-21ssh12:35:552
1612250996634,29cyclictest1687309-21sed09:51:131
161225099662,30cyclictest1771536-21/usr/sbin/munin11:51:131
161224999668,50cyclictest21-21rcuc/007:30:470
1612252996539,21cyclictest0-21swapper/307:20:013
1612252996539,21cyclictest0-21swapper/307:20:013
161225299651,30cyclictest1795509-21ntpq12:26:033
161225299651,30cyclictest1795509-21ntpq12:26:033
1612251996520,11cyclictest1767956-21tail11:46:112
1612250996558,4cyclictest81-21hwrng08:29:561
1612250996544,13cyclictest0-21swapper/109:00:461
1612252996434,25cyclictest1-21systemd11:54:233
1612252996433,25cyclictest0-21swapper/309:40:343
1612252996423,36cyclictest0-21swapper/309:25:363
161225199648,52cyclictest1739394-21ssh11:05:572
161225199642,42cyclictest37-21rcuc/209:05:472
161225099644,55cyclictest1791586-21/usr/sbin/munin12:20:441
1612250996441,10cyclictest0-21swapper/109:40:121
1612250996435,12cyclictest0-21swapper/109:25:001
1612250996435,12cyclictest0-21swapper/109:25:001
1612252996356,4cyclictest81-21hwrng10:19:303
1612252996345,14cyclictest461ktimers/308:35:133
1612252996345,14cyclictest461ktimers/308:35:133
1612252996344,15cyclictest1613923-21kworker/u16:3+xprtiod07:20:263
1612252996339,20cyclictest0-21swapper/307:36:093
1612251996340,20cyclictest1612248-21cyclictest10:06:112
161225099631,55cyclictest1752327-21ssh11:25:091
1612249996341,16cyclictest0-21swapper/008:25:370
1612251996227,29cyclictest1752338-21ssh11:25:112
1612250996224,30cyclictest1728154-21ssh10:50:341
1612252996149,10cyclictest461ktimers/308:05:563
161225199611,26cyclictest1727220-21sh10:50:452
1612250996148,9cyclictest0-21swapper/108:15:281
1612250996118,41cyclictest10550irq/171-8000000.ethernet-tx709:35:161
161224999613,22cyclictest1623640-21latency_hist07:40:010
1612252996052,4cyclictest1627938-21gltestperf07:50:353
161225299601,24cyclictest1700075-21/usr/sbin/munin10:10:343
1612251996013,37cyclictest1621619-21cron07:34:582
161224999601,19cyclictest1633849-21ntpq08:05:470
1612250995952,4cyclictest81-21hwrng07:33:371
1612250995951,5cyclictest81-21hwrng07:52:031
161225099592,48cyclictest1784314-21fschecks_time12:10:341
1612252995837,16cyclictest0-21swapper/311:07:143
1612252995819,32cyclictest1631177-21sed08:00:023
1612252995819,32cyclictest1631177-21sed08:00:023
1612250995844,10cyclictest0-21swapper/112:35:171
1612250995831,22cyclictest1696037-21ssh10:05:011
1612252995727,10cyclictest1613926-21kworker/u16:11+rpciod07:45:093
1612252995727,10cyclictest1613926-21kworker/u16:11+rpciod07:45:093
1612250995743,12cyclictest29-21rcuc/109:10:571
1612250995728,25cyclictest1788376-21ntpq12:15:511
1612250995728,25cyclictest1788376-21ntpq12:15:511
161224999571,44cyclictest0-21swapper/008:35:160
161224999571,44cyclictest0-21swapper/008:35:160
1612251995621,32cyclictest1628044-21latency07:50:372
1612252995541,12cyclictest81-21hwrng08:12:323
1612250995434,10cyclictest0-21swapper/109:05:341
1612249995440,11cyclictest0-21swapper/008:30:340
1612250995333,14cyclictest0-21swapper/108:30:411
1612250994431,8cyclictest1612269-21date07:09:591
1612250994431,8cyclictest1612269-21date07:09:591
1612251994021,16cyclictest0-21swapper/207:10:002
1612251994021,16cyclictest0-21swapper/207:10:002
1612252993831,4cyclictest1612310-21cat07:09:593
1612252993831,4cyclictest1612310-21cat07:09:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional