You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 13:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Wed Jul 29, 2026 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
66823299321298,8cyclictest79-21hwrng20:05:583
6682329916097,43cyclictest734126-21sendmail-msp21:41:023
6682309915652,53cyclictest832755-21kworker/u16:8+xprtiod00:01:261
66823099144132,7cyclictest79-21hwrng22:12:561
66823299142111,28cyclictest0-21swapper/322:20:423
668232991396,37cyclictest729662-21kworker/u16:3+rpciod21:40:013
66822999138120,14cyclictest79-21hwrng00:16:500
668230991358,26cyclictest784921-21unixbench_singl22:51:141
668230991358,26cyclictest784921-21unixbench_singl22:51:141
6682299913547,37cyclictest749627-21kworker/u16:11+rpciod22:40:010
6682299913547,37cyclictest749627-21kworker/u16:11+rpciod22:40:010
6682329913337,41cyclictest688632-21kworker/u16:14+xprtiod21:01:123
6682319913381,35cyclictest0-21swapper/222:40:472
6682309912963,62cyclictest0-21swapper/123:55:291
6682329912848,54cyclictest10950irq/205-8000000.ethernet-rx022:41:113
66822999128112,10cyclictest79-21hwrng19:45:290
6682319912516,68cyclictest791005-21/usr/sbin/munin23:00:462
668232991233,78cyclictest787944-21ntp_states22:56:063
66823199123107,5cyclictest79-21hwrng22:21:082
668232991217,40cyclictest829345-21awk23:55:373
6682319912053,48cyclictest10450irq/139-8000000.ethernet-tx321:25:202
66823299119107,9cyclictest10950irq/205-8000000.ethernet-rx023:00:543
66823299118111,4cyclictest10950irq/205-8000000.ethernet-rx023:20:083
6682299911753,59cyclictest0-21swapper/023:20:160
668229991171,26cyclictest840089-21ssh00:10:510
668232991168,34cyclictest786674-21sed22:55:013
668232991168,34cyclictest786674-21sed22:55:013
6682319911638,34cyclictest0-21swapper/220:40:012
6682319911622,67cyclictest668228-21cyclictest23:32:362
6682319911622,67cyclictest668228-21cyclictest23:32:362
66822999116107,5cyclictest79-21hwrng20:21:190
66822999116105,7cyclictest79-21hwrng00:26:030
66823199115105,7cyclictest79-21hwrng21:54:302
668232991145,97cyclictest857522-21ntp_states00:36:083
66823199114106,5cyclictest79-21hwrng00:05:352
668232991136,82cyclictest836745-21/usr/sbin/munin00:06:033
66823199113103,7cyclictest79-21hwrng23:35:532
66823199113103,7cyclictest79-21hwrng23:35:532
6682329911294,15cyclictest461ktimers/323:05:373
6682319911256,18cyclictest381ktimers/222:05:122
6682309911231,39cyclictest301ktimers/119:45:211
668230991122,82cyclictest679473-21sendmail-msp19:40:211
66823099112100,6cyclictest79-21hwrng23:44:041
6682299911296,13cyclictest816165-21timerandwakeup23:36:100
6682299911296,13cyclictest816165-21timerandwakeup23:36:100
6682299911295,12cyclictest79-21hwrng20:17:140
6682299911262,34cyclictest0-21swapper/000:06:020
66823199111102,6cyclictest79-21hwrng23:23:362
66823199111101,6cyclictest79-21hwrng20:01:522
66823099111102,5cyclictest79-21hwrng22:35:281
66823099111102,5cyclictest79-21hwrng22:35:281
6682299911155,43cyclictest0-21swapper/022:21:010
6682329911010,15cyclictest724995-21ntpq21:25:573
6682319911096,11cyclictest79-21hwrng23:25:382
668231991105,99cyclictest0-21swapper/223:40:192
6682319910998,8cyclictest79-21hwrng20:45:542
6682319910998,8cyclictest79-21hwrng20:45:542
66822999109100,6cyclictest79-21hwrng22:05:460
6682319910866,21cyclictest833327-21ntpq00:01:242
6682309910898,6cyclictest79-21hwrng21:05:211
6682309910798,5cyclictest79-21hwrng21:50:251
66823199106100,4cyclictest79-21hwrng20:31:342
6682299910594,8cyclictest79-21hwrng21:51:260
6682299910593,7cyclictest79-21hwrng00:01:290
6682299910578,19cyclictest0-21swapper/019:40:210
6682299910559,17cyclictest171ktimers/022:31:020
668229991051,81cyclictest790002-21sendmail-msp23:00:590
6682319910395,5cyclictest79-21hwrng00:17:522
6682319910394,5cyclictest79-21hwrng19:49:352
6682299910392,7cyclictest79-21hwrng00:31:110
6682329910269,29cyclictest45-21rcuc/321:21:113
6682329910269,29cyclictest45-21rcuc/321:21:113
6682329910122,37cyclictest0-21swapper/323:10:303
6682309910167,32cyclictest0-21swapper/123:47:351
6682309910167,32cyclictest0-21swapper/123:47:351
668232991008,21cyclictest808765-21ntpq23:25:533
668230991001,54cyclictest845755-21sendmail-msp00:21:101
668230991001,54cyclictest845755-21sendmail-msp00:21:101
6682299910084,8cyclictest79-21hwrng22:40:350
668229991007,58cyclictest75-21kswapd023:30:360
668229991007,58cyclictest75-21kswapd023:30:360
668231999992,5cyclictest79-21hwrng23:08:142
668230999963,31cyclictest0-21swapper/121:10:141
668230999929,14cyclictest790855-21fw_packets23:00:441
66822999993,21cyclictest688632-21kworker/u16:14+rpciod21:20:200
66822999993,21cyclictest688632-21kworker/u16:14+rpciod21:20:200
668231999883,5cyclictest79-21hwrng20:52:032
668230999885,7cyclictest79-21hwrng23:33:501
668230999885,7cyclictest79-21hwrng23:33:501
668229999885,7cyclictest79-21hwrng21:35:030
66822999982,15cyclictest785474-21kworker/u16:2+rpciod23:00:010
66822999981,32cyclictest3727682-21snmpd19:53:450
668230999758,12cyclictest10950irq/205-8000000.ethernet-rx022:41:291
668229999788,5cyclictest79-21hwrng23:55:200
668230999688,5cyclictest79-21hwrng23:51:141
668229999675,15cyclictest171ktimers/022:26:000
66822999965,18cyclictest749625-21ssh22:01:160
66823199951,77cyclictest713177-21sqv21:10:002
668230999537,44cyclictest0-21swapper/122:20:381
668230999533,55cyclictest0-21swapper/121:20:461
668230999533,55cyclictest0-21swapper/121:20:461
668229999551,31cyclictest10850irq/171-8000000.ethernet-tx700:20:430
668229999551,31cyclictest10850irq/171-8000000.ethernet-tx700:20:430
668232999481,8cyclictest822880-21ssh23:46:073
668232999481,8cyclictest822880-21ssh23:46:073
668231999450,25cyclictest656-21containerd20:41:002
668229999438,48cyclictest718109-21ssh21:16:080
668230999386,4cyclictest79-21hwrng19:33:121
668230999336,46cyclictest0-21swapper/121:36:381
668230999319,30cyclictest686954-21sendmail-msp20:00:521
668229999326,61cyclictest1121-21in:imuxsock19:20:570
668231999286,4cyclictest79-21hwrng22:37:312
668231999286,4cyclictest79-21hwrng22:37:312
668230999277,12cyclictest79-21hwrng23:27:411
668230999236,23cyclictest853727-21memory00:30:431
668230999235,41cyclictest0-21swapper/121:20:001
668229999273,8cyclictest10950irq/205-8000000.ethernet-rx023:40:190
66822999921,30cyclictest761464-21ssh22:18:290
66822999921,30cyclictest761464-21ssh22:18:290
668231999178,11cyclictest79-21hwrng22:27:162
668229999119,31cyclictest729667-21kworker/u16:15+rpciod23:20:010
66822999911,85cyclictest783674-21/usr/sbin/munin22:50:340
66822999911,85cyclictest783674-21/usr/sbin/munin22:50:340
668232999020,22cyclictest714567-21ld21:11:093
66823199906,69cyclictest784464-21ntpq22:51:072
66823199906,69cyclictest784464-21ntpq22:51:072
668230999072,6cyclictest79-21hwrng21:41:121
66823099904,43cyclictest814832-21ssh23:35:241
66823099904,43cyclictest814832-21ssh23:35:241
668230999042,43cyclictest0-21swapper/119:56:021
668230999041,33cyclictest694449-21sendmail-msp20:21:141
668230999039,16cyclictest301ktimers/122:16:081
668230999039,16cyclictest301ktimers/122:16:081
668229999045,38cyclictest0-21swapper/021:40:470
66822999901,6cyclictest0-21swapper/019:30:560
668231998979,7cyclictest79-21hwrng22:02:422
668231998970,16cyclictest850609-21ssh00:26:032
66823199895,64cyclictest826361-21ntpq23:51:052
668231998920,43cyclictest785474-21kworker/u16:2+rpciod23:00:002
66823099897,29cyclictest844728-21kworker/u16:6+xprtiod00:20:031
66823099891,18cyclictest673485-21sshd-session19:21:231
668230998910,54cyclictest1-21systemd21:30:051
668229998978,6cyclictest79-21hwrng21:01:150
668229998933,49cyclictest826643-21ssh23:51:130
66823299887,36cyclictest45-21rcuc/322:05:093
668231998880,4cyclictest79-21hwrng20:10:032
668231998879,5cyclictest79-21hwrng19:13:442
668231998874,4cyclictest822102-21diskstats23:45:372
668231998874,4cyclictest822102-21diskstats23:45:372
66823099886,35cyclictest0-21swapper/122:26:451
668230998838,14cyclictest0-21swapper/123:21:171
668230998826,15cyclictest0-21swapper/100:05:141
66822999882,22cyclictest727796-21ssh21:30:320
668229998819,27cyclictest686954-21sendmail-msp20:01:010
66822999881,22cyclictest822338-21ssh23:45:400
66822999881,22cyclictest822338-21ssh23:45:400
668231998781,4cyclictest79-21hwrng00:37:192
668231998753,24cyclictest381ktimers/220:05:462
668230998739,7cyclictest10950irq/205-8000000.ethernet-rx022:01:071
668232998676,7cyclictest10950irq/205-8000000.ethernet-rx000:01:073
668232998624,59cyclictest766822-21ntpq22:25:503
66823099865,26cyclictest669392-21ps19:11:081
668230998635,46cyclictest0-21swapper/120:40:401
668230998634,7cyclictest0-21swapper/123:10:361
668230998629,14cyclictest301ktimers/120:45:551
668230998629,14cyclictest301ktimers/120:45:551
668229998664,12cyclictest756825-21cat22:11:090
66822999863,23cyclictest740444-21ssh21:48:230
668232998537,43cyclictest853983-21ntpq00:30:593
668230998519,22cyclictest738894-21ssh21:45:521
668231998477,5cyclictest79-21hwrng21:22:462
668231998477,5cyclictest79-21hwrng21:22:462
668231998438,38cyclictest0-21swapper/220:21:012
668230998433,43cyclictest0-21swapper/120:15:351
66822999843,6cyclictest745855-21ntpq21:55:500
668229998422,22cyclictest1-21systemd19:15:470
66823299832,57cyclictest0-21swapper/322:30:143
668231998375,5cyclictest79-21hwrng19:23:592
66823099835,5cyclictest0-21swapper/122:45:591
668229998363,17cyclictest171ktimers/019:10:180
668229998344,29cyclictest797952-21ssh23:10:390
66822999834,39cyclictest714247-21ssh21:10:560
668229998329,45cyclictest724293-21df_inode21:25:320
668229998318,20cyclictest706486-21/usr/sbin/munin20:50:400
66822999831,74cyclictest699168-21ntpq20:30:450
66822999831,30cyclictest856334-21ssh00:35:070
66822999831,28cyclictest686120-21/usr/sbin/munin19:55:520
66822999831,26cyclictest809953-21ssh23:27:280
668232998264,14cyclictest846986-21ssh00:20:553
668232998264,14cyclictest846986-21ssh00:20:553
668232998248,16cyclictest818239-21apt-get23:40:113
668232998222,48cyclictest10950irq/205-8000000.ethernet-rx022:00:153
668231998274,5cyclictest79-21hwrng22:33:252
668230998230,47cyclictest0-21swapper/123:18:361
66823099821,37cyclictest3727682-21snmpd00:14:591
668229998273,5cyclictest79-21hwrng23:06:110
668231998166,11cyclictest79-21hwrng19:30:072
66823099818,35cyclictest710391-21gcc21:00:511
66823099817,28cyclictest0-21swapper/121:26:011
668230998137,9cyclictest0-21swapper/120:35:331
668230998129,16cyclictest787741-21ntpq22:55:501
668230998118,55cyclictest713144-21diskmemload22:30:381
668232998064,12cyclictest461ktimers/321:55:113
66823299801,73cyclictest716612-21sh21:15:593
668230998035,8cyclictest0-21swapper/122:06:101
668230998010,33cyclictest857450-21ssh00:35:581
66822999801,30cyclictest692057-21/usr/sbin/munin20:11:050
66822999801,30cyclictest675051-21ps19:26:040
66822999801,30cyclictest675051-21ps19:26:040
66823299798,63cyclictest728211-21/usr/sbin/munin21:30:403
66823299793,58cyclictest814450-21unix_chkpwd23:34:583
66823299793,58cyclictest814450-21unix_chkpwd23:34:583
66823299792,49cyclictest688632-21kworker/u16:14+rpciod20:20:013
668231997953,21cyclictest713452-21apt-get21:10:232
66823099796,14cyclictest674858-21ntpq19:25:461
66823099796,14cyclictest674858-21ntpq19:25:461
668230997938,19cyclictest0-21swapper/119:09:591
66822999791,32cyclictest700909-21memory20:35:380
66822999791,30cyclictest712479-21/usr/sbin/munin21:06:030
66822999791,22cyclictest781696-21ssh22:46:450
66823299783,62cyclictest684296-21sleep19:50:583
668231997865,5cyclictest79-21hwrng20:28:292
668231997865,10cyclictest79-21hwrng20:18:152
668231997854,16cyclictest0-21swapper/223:11:132
668230997855,16cyclictest0-21swapper/123:05:261
668230997834,9cyclictest0-21swapper/120:10:331
668230997831,8cyclictest0-21swapper/121:00:001
668230997827,11cyclictest0-21swapper/100:25:351
66822999781,32cyclictest690091-21mailstats20:06:040
668231997771,4cyclictest79-21hwrng21:16:372
668231997763,12cyclictest10950irq/205-8000000.ethernet-rx021:45:142
668230997768,6cyclictest79-21hwrng19:54:421
668230997730,41cyclictest0-21swapper/120:55:001
668229997713,16cyclictest661108-21kworker/u16:26+nfsiod19:40:020
66822999771,29cyclictest707748-21apt-get20:55:220
66822999771,29cyclictest704023-21apt-get20:45:110
66822999771,29cyclictest704023-21apt-get20:45:110
668231997669,4cyclictest759824-21ntpq22:15:482
668231997669,4cyclictest759824-21ntpq22:15:482
668231997629,40cyclictest0-21swapper/219:25:272
668231997629,40cyclictest0-21swapper/219:25:272
66822999762,69cyclictest702890-21ntpq20:40:500
668231997557,13cyclictest0-21swapper/221:35:152
668230997532,11cyclictest0-21swapper/121:55:431
668232997462,7cyclictest686954-21sendmail-msp20:00:583
668230997428,10cyclictest0-21swapper/119:36:031
66822999741,17cyclictest696611-21/usr/sbin/munin20:25:270
668232997360,10cyclictest668228-21cyclictest20:45:553
668232997360,10cyclictest668228-21cyclictest20:45:553
668232997348,20cyclictest0-21swapper/322:35:353
668232997348,20cyclictest0-21swapper/322:35:353
66823199731,5cyclictest0-21swapper/219:41:112
668230997334,7cyclictest301ktimers/119:15:161
668230997333,10cyclictest0-21swapper/120:26:041
668232997249,21cyclictest461ktimers/319:15:543
668232997239,20cyclictest0-21swapper/320:40:553
668231997265,4cyclictest79-21hwrng19:57:462
668231997259,6cyclictest79-21hwrng23:58:252
668232997038,21cyclictest0-21swapper/319:36:063
668231997056,7cyclictest79-21hwrng19:36:162
66823199702,50cyclictest39-21ksoftirqd/222:45:102
668230997032,9cyclictest10950irq/205-8000000.ethernet-rx020:30:271
668232996946,19cyclictest0-21swapper/319:55:273
668232996937,22cyclictest461ktimers/321:05:223
66823299692,13cyclictest816057-21mailstats23:36:093
66823299692,13cyclictest816057-21mailstats23:36:093
668231996960,6cyclictest79-21hwrng21:03:182
668231996933,34cyclictest381ktimers/221:30:592
668232996855,11cyclictest461ktimers/319:21:043
668232996846,19cyclictest0-21swapper/300:11:243
668232996842,21cyclictest0-21swapper/321:51:143
668232996834,21cyclictest461ktimers/319:10:193
668231996847,13cyclictest0-21swapper/221:40:112
668232996760,5cyclictest10950irq/205-8000000.ethernet-rx021:45:413
668232996748,15cyclictest0-21swapper/322:15:383
668232996748,15cyclictest0-21swapper/322:15:383
668232996643,12cyclictest0-21swapper/300:25:303
66823299662,41cyclictest45-21rcuc/319:45:443
668231996646,17cyclictest0-21swapper/200:20:352
668231996646,17cyclictest0-21swapper/200:20:352
668232996549,12cyclictest461ktimers/320:55:153
668232996539,22cyclictest0-21swapper/320:50:363
668231996528,35cyclictest381ktimers/222:11:442
668231996445,16cyclictest0-21swapper/223:16:252
668231996428,29cyclictest744910-21ssh21:55:162
668232996344,16cyclictest0-21swapper/319:30:323
668232996341,17cyclictest0-21swapper/322:45:393
668232996331,16cyclictest681083-21sh19:41:253
66823199634,55cyclictest854061-21ntpq00:31:042
668231996343,17cyclictest381ktimers/220:55:152
66823299627,45cyclictest825240-21ssh23:50:173
668231996218,38cyclictest0-21swapper/200:10:302
668232996123,29cyclictest0-21swapper/322:10:443
66822999611,21cyclictest668214-21munin-run19:09:580
668232996047,9cyclictest461ktimers/323:15:253
668231996034,17cyclictest0-21swapper/219:50:282
668231996028,26cyclictest671465-21cat19:16:072
668232995917,36cyclictest700451-21tail20:35:283
668232995726,27cyclictest674899-21ntpq19:25:523
668232995726,27cyclictest674899-21ntpq19:25:523
668232995635,16cyclictest0-21swapper/320:11:053
668232995536,13cyclictest0-21swapper/300:16:133
668232995530,19cyclictest697975-21sshd-auth20:27:023
668232995424,22cyclictest693505-21/usr/sbin/munin20:15:413
668231995334,9cyclictest0-21swapper/219:10:002
668232995135,10cyclictest10950irq/205-8000000.ethernet-rx020:30:373
668230994734,11cyclictest10950irq/205-8000000.ethernet-rx020:05:271
66823299403,25cyclictest0-21swapper/319:10:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional