You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-20 - 00:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot2.osadl.org (updated Sat Sep 19, 2026 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
412585799162149,8cyclictest0-21swapper/108:00:491
4125860991512,49cyclictest4097566-21kworker/u16:5+rpciod07:40:193
41258609914141,20cyclictest56242-21kworker/u16:2+xprtiod11:00:213
412586099140134,3cyclictest10550irq/205-8000000.ethernet-rx010:00:393
4125860991389,86cyclictest47-21ksoftirqd/309:55:143
4125860991261,94cyclictest119526-21basename12:25:253
4125860991261,94cyclictest119526-21basename12:25:253
412585799126108,14cyclictest0-21swapper/110:05:481
412586099124115,5cyclictest79-21hwrng12:09:463
412585799123111,9cyclictest10550irq/205-8000000.ethernet-rx011:40:131
41258579912299,18cyclictest10550irq/205-8000000.ethernet-rx010:40:531
41258579912299,18cyclictest10550irq/205-8000000.ethernet-rx010:40:531
41258609912131,30cyclictest45-21rcuc/309:14:563
4125857991172,87cyclictest0-21swapper/111:45:581
4125857991172,87cyclictest0-21swapper/111:45:581
41258589910996,10cyclictest79-21hwrng09:57:412
41258569910997,8cyclictest79-21hwrng09:25:560
4125860991066,89cyclictest76922-21ntpq11:26:093
41258609910595,8cyclictest108588-21ssh12:10:263
41258569910593,5cyclictest79-21hwrng08:06:040
41258609910473,20cyclictest0-21swapper/309:41:123
41258569910379,20cyclictest79-21hwrng08:01:580
41258569910293,6cyclictest79-21hwrng10:37:370
4125858991015,62cyclictest76-21kswapd011:15:322
4125857991011,84cyclictest321-21ntpq09:41:131
41258589910088,8cyclictest0-21swapper/210:51:012
4125857999871,21cyclictest301ktimers/109:21:071
4125857999845,47cyclictest4183210-21ssh09:25:551
412585799981,29cyclictest4142539-21kworker/u16:4+rpciod07:59:571
4125856999890,5cyclictest79-21hwrng12:20:010
4125860999756,36cyclictest0-21swapper/310:35:553
412586099964,77cyclictest65783-21ntpq11:10:503
412586099964,77cyclictest65783-21ntpq11:10:503
4125857999675,18cyclictest0-21swapper/109:19:561
4125856999653,36cyclictest0-21swapper/010:00:460
4125858999545,43cyclictest0-21swapper/212:00:442
4125858999545,43cyclictest0-21swapper/212:00:442
4125856999543,3cyclictest9850irq/123-8000000.ethernet-tx109:00:480
4125860999444,29cyclictest0-21swapper/311:20:133
412585899949,81cyclictest4189646-21cut09:35:272
412585899949,81cyclictest4189646-21cut09:35:272
4125858999478,12cyclictest79-21hwrng11:45:122
4125858999478,12cyclictest79-21hwrng11:45:122
4125858999281,5cyclictest0-21swapper/207:21:122
4125856999255,13cyclictest0-21swapper/010:40:580
4125856999255,13cyclictest0-21swapper/010:40:580
412586099917,56cyclictest0-21swapper/312:01:113
412586099917,56cyclictest0-21swapper/312:01:113
4125860999175,10cyclictest10550irq/205-8000000.ethernet-rx010:42:203
4125860999175,10cyclictest10550irq/205-8000000.ethernet-rx010:42:203
4125857999175,12cyclictest111152-21sleep12:13:241
4125856999136,38cyclictest4129408-21kworker/u16:12+rpciod07:19:580
412585799902,33cyclictest31-21ksoftirqd/110:50:131
412585799901,19cyclictest80362-21ntpq11:30:491
4125860998963,21cyclictest461ktimers/309:35:113
4125860998963,21cyclictest461ktimers/309:35:113
412585899891,82cyclictest109614-21ssh12:10:582
4125856998963,23cyclictest0-21swapper/011:50:320
4125860998861,12cyclictest98742-21ntp_states11:56:013
4125857998866,19cyclictest301ktimers/109:30:511
4125856998868,16cyclictest79-21hwrng11:06:170
4125856998868,16cyclictest0-21swapper/008:21:050
4125860998760,17cyclictest10550irq/205-8000000.ethernet-rx009:20:193
4125857998767,17cyclictest0-21swapper/111:20:301
4125860998663,16cyclictest0-21swapper/310:34:563
412586099865,71cyclictest3958-21ssh09:46:013
412586099865,71cyclictest3958-21ssh09:46:013
4125858998660,21cyclictest0-21swapper/211:20:132
4125858998653,30cyclictest381ktimers/209:50:462
4125857998574,6cyclictest301ktimers/112:38:271
4125856998550,15cyclictest0-21swapper/009:30:360
4125860998457,22cyclictest0-21swapper/310:18:443
4125860998445,22cyclictest461ktimers/308:15:583
4125860998445,22cyclictest461ktimers/308:15:583
4125858998457,14cyclictest0-21swapper/210:20:142
4125858998438,33cyclictest0-21swapper/211:05:292
4125856998441,40cyclictest0-21swapper/012:05:330
4125860998356,24cyclictest461ktimers/312:34:563
4125860998330,31cyclictest4125855-21cyclictest07:29:563
4125860998330,31cyclictest4125855-21cyclictest07:29:563
4125858998373,7cyclictest79-21hwrng07:10:462
412585899831,46cyclictest82871-21latency_hist11:34:572
4125856998360,13cyclictest0-21swapper/009:41:220
4125857998252,25cyclictest301ktimers/110:10:441
4125856998262,9cyclictest0-21swapper/007:20:510
4125860998159,11cyclictest4122199-21kworker/u16:4+xprtiod07:21:173
4125857998175,3cyclictest10550irq/205-8000000.ethernet-rx010:00:511
4125856998144,23cyclictest0-21swapper/011:41:200
4125856998042,30cyclictest0-21swapper/010:21:260
4125860997942,27cyclictest45-21rcuc/308:20:133
4125857997862,13cyclictest0-21swapper/110:39:561
4125857997854,19cyclictest301ktimers/109:35:581
4125857997854,19cyclictest301ktimers/109:35:581
4125856997862,6cyclictest79-21hwrng10:30:270
4125860997769,5cyclictest10550irq/205-8000000.ethernet-rx010:20:233
4125860997724,42cyclictest56834-21sleep10:59:133
412585899776,52cyclictest4168680-21kworker/u16:19+xprtiod09:20:412
4125857997762,12cyclictest0-21swapper/107:41:081
412585799774,55cyclictest10195-21aten_r8power_cu09:55:261
412585799771,66cyclictest119464-21ssh12:25:171
412585799771,66cyclictest119464-21ssh12:25:171
412585699773,39cyclictest72636-21ssh11:20:580
4125860997637,31cyclictest0-21swapper/312:35:433
4125858997638,32cyclictest0-21swapper/211:00:322
412585899761,63cyclictest118110-21sleep12:22:412
4125856997670,3cyclictest79-21hwrng08:35:450
4125856997662,10cyclictest0-21swapper/012:11:120
4125860997558,14cyclictest461ktimers/312:15:173
4125860997558,14cyclictest461ktimers/312:15:173
412585899751,72cyclictest0-21swapper/211:35:482
412585899751,72cyclictest0-21swapper/211:35:482
412585799757,59cyclictest9750irq/115-8000000.ethernet-tx010:19:571
4125857997543,22cyclictest0-21swapper/110:21:211
4125856997558,11cyclictest0-21swapper/010:55:350
4125856997551,20cyclictest0-21swapper/011:25:100
412585699751,39cyclictest51824-21/usr/sbin/munin10:51:090
4125856997450,21cyclictest0-21swapper/010:06:080
4125856997435,29cyclictest19-21rcu_preempt09:35:580
4125856997435,29cyclictest19-21rcu_preempt09:35:580
4125860997367,4cyclictest10550irq/205-8000000.ethernet-rx012:22:203
4125860997357,11cyclictest45-21rcuc/311:05:513
4125860997351,19cyclictest461ktimers/307:30:103
4125860997337,30cyclictest0-21swapper/308:40:433
4125860997325,16cyclictest0-21swapper/308:39:583
4125858997350,19cyclictest0-21swapper/210:00:382
4125858997341,28cyclictest0-21swapper/209:00:282
412585899731,53cyclictest39-21ksoftirqd/211:50:432
4125856997347,14cyclictest0-21swapper/009:51:040
4125856997341,29cyclictest0-21swapper/009:21:050
4125860997250,12cyclictest461ktimers/307:35:093
4125860997250,12cyclictest461ktimers/307:35:093
412586099721,40cyclictest72001-21sed11:19:593
412586099720,58cyclictest21075-21ssh10:10:153
4125857997247,21cyclictest0-21swapper/111:36:101
4125857997247,21cyclictest0-21swapper/111:36:101
4125857997237,18cyclictest10550irq/205-8000000.ethernet-rx010:30:411
4125856997236,31cyclictest0-21swapper/007:40:400
4125860997165,4cyclictest10550irq/205-8000000.ethernet-rx009:15:123
412586099712,17cyclictest4144852-21modprobe08:00:173
4125858997136,31cyclictest0-21swapper/212:05:322
4125857997155,12cyclictest0-21swapper/111:01:081
4125857997140,23cyclictest0-21swapper/107:20:131
4125856997158,9cyclictest0-21swapper/011:01:030
4125856997151,15cyclictest0-21swapper/011:36:060
4125856997151,15cyclictest0-21swapper/011:36:060
4125856997145,23cyclictest0-21swapper/010:10:090
4125856997139,25cyclictest0-21swapper/012:29:570
4125856997139,25cyclictest0-21swapper/012:29:570
412585699713,54cyclictest4157520-21kworker/u16:6+rpciod08:40:560
4125856997122,46cyclictest0-21swapper/009:16:060
412586099706,6cyclictest17743-21df_inode10:05:283
4125860997048,11cyclictest0-21swapper/309:50:043
4125860997045,18cyclictest461ktimers/308:55:503
4125860997030,33cyclictest4126813-21ntpq07:10:373
412585899702,33cyclictest3736584-21kworker/2:2+pm08:05:102
4125857997048,13cyclictest0-21swapper/107:54:561
4125857997048,13cyclictest0-21swapper/107:54:561
4125857997046,17cyclictest0-21swapper/109:45:331
4125857997046,17cyclictest0-21swapper/109:45:331
4125857997039,22cyclictest301ktimers/108:55:461
4125856997046,17cyclictest0-21swapper/010:46:050
4125856997043,23cyclictest0-21swapper/012:34:570
4125856997024,32cyclictest90241-21ssh11:45:070
4125856997024,32cyclictest90241-21ssh11:45:070
4125860996951,16cyclictest461ktimers/308:25:103
4125858996935,26cyclictest42669-21sendmail-msp10:41:172
4125858996935,26cyclictest42669-21sendmail-msp10:41:172
4125857996960,7cyclictest0-21swapper/112:16:031
4125857996960,7cyclictest0-21swapper/112:16:031
4125857996957,9cyclictest0-21swapper/110:45:501
4125857996946,20cyclictest301ktimers/111:50:101
4125856996949,16cyclictest0-21swapper/011:30:090
4125856996945,13cyclictest171ktimers/008:15:100
4125856996945,13cyclictest171ktimers/008:15:100
4125860996855,10cyclictest461ktimers/309:30:233
4125858996858,6cyclictest0-21swapper/207:19:572
4125858996848,17cyclictest0-21swapper/208:15:302
4125858996848,17cyclictest0-21swapper/208:15:302
4125858996847,11cyclictest0-21swapper/210:25:352
4125857996859,6cyclictest0-21swapper/108:40:091
4125857996812,37cyclictest4152110-21sendmail-msp08:20:561
4125856996855,9cyclictest0-21swapper/007:09:560
4125856996855,9cyclictest0-21swapper/007:09:560
4125856996854,8cyclictest0-21swapper/012:15:580
4125856996854,8cyclictest0-21swapper/012:15:580
4125856996850,11cyclictest0-21swapper/010:15:130
4125856996841,20cyclictest0-21swapper/012:00:560
4125856996841,20cyclictest0-21swapper/012:00:560
4125860996756,6cyclictest79-21hwrng07:19:593
4125860996747,12cyclictest461ktimers/308:45:213
4125860996741,22cyclictest45-21rcuc/311:30:513
4125860996724,31cyclictest45-21rcuc/311:35:423
4125860996724,31cyclictest45-21rcuc/311:35:423
4125858996759,5cyclictest381ktimers/210:55:482
4125858996754,9cyclictest0-21swapper/209:25:342
4125858996754,5cyclictest4192811-21sendmail-msp09:41:122
412585899675,40cyclictest0-21swapper/208:00:592
4125858996751,13cyclictest0-21swapper/209:15:102
412585899672,58cyclictest0-21swapper/212:30:452
4125857996763,2cyclictest0-21swapper/110:25:151
4125857996746,13cyclictest98584-21sh11:55:491
4125856996733,12cyclictest8603-21kworker/u16:5+rpciod09:59:590
4125860996655,8cyclictest0-21swapper/311:40:543
4125860996631,29cyclictest4149363-21ntpq08:10:453
4125858996641,20cyclictest381ktimers/208:55:432
4125858996632,28cyclictest0-21swapper/211:40:382
412585899661,51cyclictest40381-21ssh10:35:532
4125857996650,7cyclictest0-21swapper/107:35:501
4125857996650,7cyclictest0-21swapper/107:35:501
4125857996641,21cyclictest0-21swapper/112:01:271
4125857996641,21cyclictest0-21swapper/112:01:271
412585799663,17cyclictest0-21swapper/111:25:461
4125860996552,3cyclictest4167066-21sendmail-msp09:00:223
4125860996544,18cyclictest45-21rcuc/310:50:503
4125860996534,27cyclictest45-21rcuc/307:50:533
4125860996534,27cyclictest45-21rcuc/307:50:533
412586099652,42cyclictest95023-21sh11:50:543
4125858996542,10cyclictest0-21swapper/210:10:412
4125858996531,24cyclictest97582-21ssh11:55:122
4125857996543,18cyclictest301ktimers/112:30:101
4125857996538,20cyclictest4125855-21cyclictest11:05:071
4125856996553,10cyclictest0-21swapper/012:35:340
4125856996543,18cyclictest0-21swapper/009:10:320
4125856996539,11cyclictest9750irq/115-8000000.ethernet-tx011:19:560
4125856996523,34cyclictest97629-21sh11:55:180
4125860996451,9cyclictest0-21swapper/311:45:253
4125860996451,9cyclictest0-21swapper/311:45:253
4125860996450,11cyclictest461ktimers/308:50:103
4125860996449,11cyclictest0-21swapper/310:45:333
4125858996445,11cyclictest0-21swapper/210:15:342
4125858996442,12cyclictest0-21swapper/208:36:042
4125858996438,18cyclictest0-21swapper/210:30:332
4125858996432,25cyclictest64794-21ssh11:10:172
4125858996432,25cyclictest64794-21ssh11:10:172
4125857996423,36cyclictest4147921-21timerwakeupswit08:06:021
4125857996418,29cyclictest99728-21kworker/u16:6+rpciod12:20:201
4125856996444,9cyclictest0-21swapper/007:26:060
4125856996444,9cyclictest0-21swapper/007:26:060
4125856996444,12cyclictest0-21swapper/008:50:310
4125856996438,20cyclictest0-21swapper/010:25:090
412585699643,47cyclictest64742-21ssh11:10:080
412585699643,47cyclictest64742-21ssh11:10:080
412585699641,26cyclictest3321-21gltestperf09:45:320
412585699641,26cyclictest3321-21gltestperf09:45:320
412586099637,38cyclictest47-21ksoftirqd/308:05:103
4125860996339,16cyclictest0-21swapper/309:25:353
412586099632,39cyclictest2447021-21snmpd07:45:473
4125858996349,10cyclictest0-21swapper/208:20:412
4125858996344,15cyclictest0-21swapper/210:09:562
4125858996341,18cyclictest0-21swapper/207:40:532
4125858996329,28cyclictest4169983-21ntpq09:05:472
4125857996344,12cyclictest301ktimers/107:30:291
412585799631,40cyclictest4114951-21kworker/u16:7+rpciod07:10:061
4125858996240,19cyclictest0-21swapper/212:15:332
4125858996240,19cyclictest0-21swapper/212:15:332
4125858996237,18cyclictest0-21swapper/208:41:082
4125858996235,19cyclictest0-21swapper/211:25:112
4125858996225,34cyclictest10450irq/171-8000000.ethernet-tx712:25:322
4125858996225,34cyclictest10450irq/171-8000000.ethernet-tx712:25:322
4125857996228,27cyclictest301ktimers/108:45:521
412585799622,47cyclictest68422-21ssh11:15:111
4125856996240,15cyclictest0-21swapper/008:10:320
4125856996238,18cyclictest0-21swapper/008:25:240
4125856996229,29cyclictest4169169-21apt-get09:05:230
4125860996141,16cyclictest0-21swapper/307:09:573
4125860996141,16cyclictest0-21swapper/307:09:573
4125858996147,11cyclictest0-21swapper/209:10:252
4125858996133,24cyclictest4133600-21sshd07:30:172
4125857996155,4cyclictest31-21ksoftirqd/109:50:161
4125857996145,10cyclictest301ktimers/110:55:121
4125857996134,14cyclictest301ktimers/109:05:471
4125857996127,29cyclictest4140071-21ntpq07:45:531
4125857996118,4cyclictest10350irq/163-8000000.ethernet-tx611:10:521
4125857996118,4cyclictest10350irq/163-8000000.ethernet-tx611:10:521
412585799611,28cyclictest4167608-21grep09:00:361
4125856996148,10cyclictest0-21swapper/007:55:260
4125856996145,12cyclictest0-21swapper/008:30:190
4125856996133,24cyclictest4140841-21apt-get07:49:560
412585899606,44cyclictest126810-21ssh12:35:232
4125857996037,16cyclictest301ktimers/109:10:581
4125857996026,21cyclictest60343-21kworker/u16:23+xprtiod12:05:161
412586099591,40cyclictest32003-21910:25:123
4125858995936,21cyclictest381ktimers/208:45:122
4125857995944,10cyclictest0-21swapper/107:25:081
4125857995944,10cyclictest0-21swapper/107:25:081
4125857995935,20cyclictest301ktimers/108:35:101
4125856995938,17cyclictest0-21swapper/007:30:320
412585899586,41cyclictest4140841-21apt-get07:49:592
412585899586,41cyclictest4140841-21apt-get07:49:592
4125856995841,9cyclictest0-21swapper/007:50:100
4125856995841,9cyclictest0-21swapper/007:50:100
412585699583,46cyclictest4137115-21sh07:39:560
412585699583,46cyclictest4137115-21sh07:39:560
4125858995732,15cyclictest0-21swapper/207:25:082
4125858995732,15cyclictest0-21swapper/207:25:082
4125856995736,9cyclictest0-21swapper/008:55:260
4125858995636,17cyclictest0-21swapper/210:49:552
4125857995646,4cyclictest0-21swapper/108:15:071
4125857995646,4cyclictest0-21swapper/108:15:071
412586099554,38cyclictest47-21ksoftirqd/308:30:513
4125860995541,10cyclictest0-21swapper/309:06:093
4125858995540,12cyclictest0-21swapper/209:30:342
4125858995539,13cyclictest381ktimers/208:50:182
4125858995534,17cyclictest0-21swapper/208:25:292
4125857995537,7cyclictest0-21swapper/108:31:021
4125857995536,9cyclictest0-21swapper/107:19:561
4125857995528,24cyclictest4164091-21irqstats08:50:331
4125856995529,23cyclictest4163203-21sshd-auth08:48:170
412585899544,27cyclictest4129407-21kworker/u16:11+rpciod07:59:562
4125858995427,23cyclictest4139314-21/usr/sbin/munin07:45:252
4125858995425,25cyclictest648-21lldpd07:35:522
4125858995425,25cyclictest648-21lldpd07:35:522
4125858995424,22cyclictest381ktimers/208:30:102
4125858995424,12cyclictest2865-21ssh09:45:232
4125858995424,12cyclictest2865-21ssh09:45:232
4125857995433,14cyclictest0-21swapper/108:25:311
4125856995438,10cyclictest0-21swapper/007:10:310
4125860995324,25cyclictest4143227-21diskstats07:55:293
4125857995335,16cyclictest29-21rcuc/108:10:081
4125858995231,17cyclictest4149220-21memory08:10:362
4125857994428,8cyclictest0-21swapper/107:09:571
4125857994228,8cyclictest4125826-21sleep07:09:551
412585899352,23cyclictest4125980-21latency_hist07:09:572
412585899352,23cyclictest4125980-21latency_hist07:09:572
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional