You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 00:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8s.osadl.org (updated Sun Dec 21, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33343529912640,1261cyclictest36973152sleep311:50:013
3334352993250,321cyclictest3458705-21turbostat08:49:553
3334352992321,0cyclictest0-21swapper/310:10:003
3334352992119,1cyclictest0-21swapper/307:15:003
35047132191,15sleep23504852-21sed09:20:152
3334352991916,1cyclictest0-21swapper/308:05:013
3334352991916,1cyclictest0-21swapper/307:14:593
333435299172,11cyclictest3471765-21turbostat08:55:013
3334352991714,1cyclictest0-21swapper/310:25:253
3334352991714,1cyclictest0-21swapper/310:25:243
3334352991714,1cyclictest0-21swapper/309:30:173
33333022170,4sleep30-21swapper/307:05:233
333435299165,8cyclictest3658521-21turbostat11:24:553
3334352991614,1cyclictest0-21swapper/311:00:023
3334352991614,1cyclictest0-21swapper/310:10:163
3334352991614,1cyclictest0-21swapper/309:50:013
3334352991613,1cyclictest0-21swapper/311:55:153
3334352991613,1cyclictest0-21swapper/309:19:583
333435299161,11cyclictest3607102-21taskset10:40:133
3334352991610,3cyclictest0-21swapper/308:25:013
33755832151,11sleep13375735-21df_inode07:40:131
33620602151,5sleep13362077-21munin-run07:30:011
33496782151,4sleep03349793-21fw_packets07:20:130
333435299155,8cyclictest3652079-21turbostat11:19:553
3334352991513,1cyclictest0-21swapper/310:31:113
3334352991513,1cyclictest0-21swapper/310:04:543
3334352991512,1cyclictest0-21swapper/312:17:053
3334352991512,1cyclictest0-21swapper/308:33:083
3334352991512,1cyclictest0-21swapper/308:30:013
333435299151,10cyclictest3446081-21taskset08:35:133
333435299141,9cyclictest33623222sleep307:30:143
333435299141,9cyclictest3349525-21taskset07:20:123
3334352991413,0cyclictest0-21swapper/311:40:333
3334352991412,1cyclictest0-21swapper/312:02:503
3334352991412,1cyclictest0-21swapper/311:09:053
3334352991412,1cyclictest0-21swapper/310:16:033
3334352991411,1cyclictest0-21swapper/312:25:073
3334352991411,1cyclictest0-21swapper/311:39:403
3334352991411,1cyclictest0-21swapper/310:58:073
3334352991411,1cyclictest0-21swapper/310:48:563
3334352991411,1cyclictest0-21swapper/309:42:553
3334352991411,1cyclictest0-21swapper/308:45:003
3334352991411,1cyclictest0-21swapper/308:12:103
3334352991411,1cyclictest0-21swapper/307:35:223
333435299141,10cyclictest3671714-21taskset11:30:133
333435299141,10cyclictest3584593-21taskset10:20:173
333435299141,10cyclictest3555134-21chrt09:55:583
333435299141,10cyclictest3544371-21taskset09:50:163
333435299141,10cyclictest3388410-21taskset07:50:133
333435299140,11cyclictest3626091-21taskset10:54:553
333435299140,10cyclictest3412715-21taskset08:05:193
333435299140,10cyclictest3412715-21taskset08:05:193
301798140,7rtkit-daemon492-21gmain11:40:572
333435299134,7cyclictest3753880-21taskset12:30:203
333435299134,6cyclictest3665273-21chrt11:25:133
333435299134,6cyclictest34850882sleep309:05:113
333435299133,7cyclictest3478716-21taskset09:00:123
333435299131,9cyclictest3755208-21taskset12:35:123
333435299131,9cyclictest3361811-21taskset07:26:483
3334352991312,0cyclictest0-21swapper/312:10:483
3334352991311,1cyclictest0-21swapper/312:20:193
3334352991311,1cyclictest0-21swapper/309:25:143
3334352991311,1cyclictest0-21swapper/309:00:003
3334352991311,1cyclictest0-21swapper/307:48:523
333435299131,10cyclictest3381498-21taskset07:42:233
3334352991310,1cyclictest0-21swapper/307:55:153
333435299130,10cyclictest3722430-21taskset12:06:123
301798130,6rtkit-daemon3205-21sendmail-mta11:06:352
333435299129,1cyclictest0-21swapper/309:35:153
333435299121,9cyclictest3491528-21taskset09:10:053
3334352991210,1cyclictest0-21swapper/310:35:103
333435299120,9cyclictest3690928-21chrt11:45:033
333435299120,9cyclictest3645871-21chrt11:10:073
333435299120,9cyclictest3426218-21taskset08:15:403
36587782111,7sleep23658779-21/usr/sbin/munin11:20:112
36072942111,7sleep13607478-21/usr/sbin/munin10:40:161
333435299111,7cyclictest3504377-21taskset09:20:113
301798110,1rtkit-daemon0-21swapper/208:06:122
301798110,1rtkit-daemon0-21swapper/208:06:122
35554492101,5sleep03555514-21munin-run10:00:000
35235802101,6sleep13523653-21tr09:35:131
301798100,5rtkit-daemon3638175-21memory11:00:202
301798100,5rtkit-daemon3599557-21ntp_states10:30:222
301798100,5rtkit-daemon3587145-21/usr/sbin/munin10:20:242
301798100,5rtkit-daemon3497679-21cron09:15:002
301798100,5rtkit-daemon3484879-21munin-run09:05:002
3742511291,5sleep23742711-21hddtemp_smartct12:25:142
3729138291,5sleep13729148-21munin-run12:15:001
3684565291,4sleep03684708-21df11:40:140
3594216291,4sleep03594249-21apt-get10:30:130
3567383291,5sleep23567439-21ntp_states10:05:232
3451501290,7sleep13446046-21/usr/sbin/munin08:35:231
3441525291,5sleep13443593-21kthreadcore08:30:181
3381963291,4sleep13381995-21apt-get07:45:141
3328103291,3sleep20-21swapper/207:05:132
30179890,5rtkit-daemon667-21lldpd09:55:152
30179890,5rtkit-daemon448-21wpa_supplicant08:43:362
30179890,5rtkit-daemon3478648-21latency_hist09:00:012
30179890,5rtkit-daemon3205-21sendmail-mta12:02:512
30179890,5rtkit-daemon3205-21sendmail-mta09:32:222
30179890,5rtkit-daemon3205-21sendmail-mta07:43:062
30179890,4rtkit-daemon3426381-21chrt08:17:442
30179890,4rtkit-daemon3348030-21cut07:15:162
3723458280,1sleep20-21swapper/212:10:162
3716768281,4sleep23716967-21hddtemp_smartct12:05:162
3710203282,2sleep13710236-21apt-get12:00:131
3652059280,5sleep03652066-21latency_hist11:15:000
3606132281,4sleep03606377-21awk10:35:230
3581409281,3sleep13581441-21apt-get10:20:121
3562538281,5sleep03562791-21irqcore10:05:170
3536503281,4sleep13536658-21diskstats09:45:151
3485540281,4sleep03486379-21cut09:05:200
3432098281,4sleep23432157-21ntp_states08:20:212
3414399280,6sleep13414658-21irqcore08:10:151
3390935280,5sleep03393089-21kthreadcore07:50:190
3341001280,5sleep13341508-21kthreadcore07:15:011
30179880,5rtkit-daemon3205-21sendmail-mta09:07:162
30179880,4rtkit-daemon667-21lldpd09:16:002
30179880,4rtkit-daemon638-21ntpd08:45:182
30179880,4rtkit-daemon636-21snmpd11:58:302
30179880,4rtkit-daemon636-21snmpd11:53:202
30179880,4rtkit-daemon492-21gmain10:40:042
30179880,4rtkit-daemon492-21gmain10:36:492
30179880,4rtkit-daemon492-21gmain07:47:362
30179880,4rtkit-daemon492-21gmain07:20:292
30179880,4rtkit-daemon448-21wpa_supplicant10:26:122
30179880,4rtkit-daemon448-21wpa_supplicant10:26:112
30179880,4rtkit-daemon448-21wpa_supplicant09:49:102
30179880,4rtkit-daemon447-21systemd-logind07:33:332
30179880,4rtkit-daemon3667893-21kthreadcore11:25:182
30179880,4rtkit-daemon3632552-21munin-run11:00:002
30179880,4rtkit-daemon3556085-21sed10:00:172
30179880,4rtkit-daemon3433703-21cat08:25:142
30179880,4rtkit-daemon3402229-21irqrtprio08:00:162
30179880,4rtkit-daemon3340802-21munin-node10:50:172
30179880,4rtkit-daemon3340802-21munin-node10:18:052
30179880,4rtkit-daemon3340802-21munin-node09:43:012
30179880,4rtkit-daemon3340802-21munin-node09:39:052
30179880,4rtkit-daemon3340802-21munin-node08:54:482
30179880,4rtkit-daemon3340802-21munin-node08:36:202
30179880,4rtkit-daemon3205-21sendmail-mta11:13:312
30179880,4rtkit-daemon3205-21sendmail-mta09:26:452
30179880,4rtkit-daemon297-21systemd-journal11:39:032
30179880,4rtkit-daemon0-21swapper/211:18:362
30179880,1rtkit-daemon0-21swapper/212:39:542
30179880,1rtkit-daemon0-21swapper/212:23:392
3754148271,3sleep23754239-21switchtime12:30:232
3703744270,3sleep13703777-21apt-get11:55:131
3697330271,3sleep13697363-21apt-get11:50:111
3686691270,4sleep13688781-21grep11:40:191
3674179271,4sleep03676303-21kthreadcore11:30:200
3652317271,2sleep03652350-21apt-get11:15:130
3626746270,5sleep13626877-21irqcore10:55:141
3619660270,4sleep03619737-21date10:50:000
3600661271,3sleep13600683-21apt-get10:35:121
3574988271,2sleep00-21swapper/010:15:150
3573877271,4sleep13573983-21mailstats10:10:241
3561161270,4sleep03561270-21find10:00:250
3523544271,3sleep03523577-21apt-get09:35:130
3478766271,4sleep03478875-21/usr/sbin/munin09:00:140
3459338270,4sleep13459732-21cut08:45:161
3402286271,4sleep03403450-21cut08:00:160
3388815271,4sleep20-21swapper/207:50:172
3375547271,3sleep03375580-21apt-get07:40:130
3334903270,4sleep13335040-21sed07:10:171
3328283270,3sleep03328296-21diskstats07:05:150
30179870,4rtkit-daemon638-21ntpd12:15:132
30179870,4rtkit-daemon638-21ntpd11:47:252
30179870,4rtkit-daemon638-21ntpd07:35:412
30179870,3rtkit-daemon638-21ntpd10:47:082
30179870,3rtkit-daemon638-21ntpd09:51:552
30179870,3rtkit-daemon636-21snmpd11:32:102
30179870,3rtkit-daemon636-21snmpd08:30:042
30179870,3rtkit-daemon636-21snmpd07:25:072
30179870,3rtkit-daemon448-21wpa_supplicant07:55:142
30179870,3rtkit-daemon447-21systemd-logind07:11:342
30179870,3rtkit-daemon3205-21sendmail-mta10:12:322
30179870,2rtkit-daemon3416060-21kthreadcore08:10:172
3761058260,1sleep00-21swapper/012:36:310
3750851260,3sleep13752944-21grep12:30:181
3747579260,3sleep03747640-21ntpq12:25:210
3718576261,2sleep10-21swapper/112:05:181
3701268260,3sleep03702453-21memory11:50:180
3678092261,2sleep13678125-21apt-get11:35:131
3639861261,2sleep10-21swapper/111:05:161
3635692260,4sleep03637856-21kthreadcore11:00:190
3613515260,1sleep10-21swapper/110:45:131
3609370260,3sleep03611473-21grep10:40:190
3595669261,3sleep10-21swapper/110:30:181
3588219260,3sleep03588707-21irqcore10:25:170
3588219260,3sleep03588707-21irqcore10:25:160
3523286260,3sleep03523330-21munin-run09:35:000
3514945260,3sleep0221rcuc/009:25:170
3474873260,3sleep13477016-21kthreadcore08:55:181
3470748260,3sleep03470871-21ntp_kernel_pll_08:50:200
3466656260,3sleep13467820-21cut08:50:181
3452854260,3sleep13452996-21ps08:40:161
3444909260,4sleep03444969-21open_inodes08:30:210
3407627260,3sleep03407688-21grep08:05:140
3407627260,3sleep03407688-21grep08:05:130
3400725260,1sleep10-21swapper/107:57:481
3367711261,2sleep10-21swapper/107:30:241
3357358260,3sleep03358594-21cut07:25:190
3340651261,3sleep03341000-21fw_packets07:15:000
3744021251,2sleep10-21swapper/112:25:171
3735341250,1sleep00-21swapper/012:16:390
3729389250,1sleep10-21swapper/112:15:071
3723177250,3sleep03723305-21expr12:10:150
3717550251,2sleep00-21swapper/012:05:170
3697072250,2sleep13697093-21munin-run11:49:591
3629758250,2sleep00-21swapper/010:55:170
3619912250,3sleep10-21swapper/110:50:101
3576429250,2sleep13578206-21kthreadcore10:15:191
3569920250,3sleep03570990-21cat10:10:180
3548834250,1sleep10-21swapper/109:52:071
3536153250,1sleep00-21swapper/009:44:170
3536070250,1sleep10-21swapper/109:43:141
3511162250,3sleep13511741-21ps09:25:151
3505858250,3sleep03507796-21grep09:20:180
3497930250,2sleep10-21swapper/109:15:131
3491537250,2sleep03491570-21apt-get09:10:110
3464744250,1sleep00-21swapper/008:45:270
3458650250,1sleep00-21swapper/008:44:360
3452182250,1sleep00-21swapper/008:39:260
3432768250,1sleep00-21swapper/008:22:070
3427235251,2sleep10-21swapper/108:20:161
3419878250,1sleep00-21swapper/008:11:220
3368724250,2sleep10-21swapper/107:35:141
3355435250,1sleep10-21swapper/107:22:181
3749725240,2sleep00-21swapper/012:30:170
3735881240,1sleep00-21swapper/012:20:120
3714764240,2sleep00-21swapper/012:00:200
3709695240,3sleep00-21swapper/011:57:040
3670693240,2sleep13670825-21timerandwakeup11:25:231
3667234240,2sleep00-21swapper/011:25:180
3660331241,1sleep00-21swapper/011:20:170
3658465240,3sleep10-21swapper/111:19:351
3588710240,2sleep13589671-21kthreadcore10:25:181
3588710240,2sleep13589671-21kthreadcore10:25:171
3562794240,2sleep1321rcuc/110:05:181
3555730240,1sleep10-21swapper/110:00:141
3536468240,1sleep00-21swapper/009:45:140
3510421240,1sleep10-21swapper/109:24:001
3503892240,3sleep00-21swapper/009:17:290
3486380240,2sleep13487553-21kthreadcore09:05:211
3473694240,2sleep03473761-21kthreadcore08:55:180
3432992240,3sleep10-21swapper/108:25:021
3426310240,2sleep10-21swapper/108:16:521
3409375241,1sleep10-21swapper/108:05:191
3409375241,1sleep10-21swapper/108:05:181
3403451240,2sleep13405567-21kthreadcore08:00:171
3368193240,3sleep00-21swapper/007:31:310
3340555240,1sleep00-21swapper/007:13:490
3761039230,1sleep10-21swapper/112:36:161
3737141230,1sleep10-21swapper/112:20:171
3691133230,1sleep00-21swapper/011:45:130
3678297230,1sleep00-21swapper/011:35:160
3658973230,1sleep10-21swapper/111:20:141
3645623230,1sleep10-21swapper/111:10:011
3639660230,1sleep00-21swapper/011:05:150
3633331230,1sleep10-21swapper/111:00:161
3624327230,1sleep00-21swapper/010:50:210
3581407230,1sleep00-21swapper/010:20:110
3550775230,1sleep10-21swapper/109:55:201
3548756230,1sleep00-21swapper/009:51:060
3492990230,1sleep10-21swapper/109:10:161
3482485230,1sleep10-21swapper/109:00:191
3436415230,1sleep00-21swapper/008:25:170
3425741230,1sleep00-21swapper/008:15:230
3394762230,1sleep00-21swapper/007:55:110
3393092230,1sleep10-21swapper/107:50:201
3381949230,1sleep00-21swapper/007:45:050
3374577230,1sleep00-21swapper/007:35:480
3328297230,1sleep10-21swapper/107:05:161
3671665220,1sleep10-21swapper/111:30:051
3517141220,1sleep10-21swapper/109:30:051
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional