You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 00:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8s.osadl.org (updated Mon Dec 29, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36319329912640,1261cyclictest40145222sleep312:04:573
36319329912430,1239cyclictest38728542sleep310:15:013
3631932993300,327cyclictest3660121-21turbostat07:34:563
3631932992220,1cyclictest0-21swapper/310:15:003
3631932992118,1cyclictest0-21swapper/312:00:003
3631932991916,1cyclictest0-21swapper/308:20:003
3631932991913,3cyclictest3898604-21sleep10:35:003
363193299191,13cyclictest3802338-21taskset09:20:123
3631932991815,1cyclictest0-21swapper/307:15:003
363193299172,11cyclictest4059410-21turbostat12:40:013
3631932991714,1cyclictest0-21swapper/311:00:153
3631932991713,1cyclictest0-21swapper/311:44:373
363193299167,6cyclictest3814916-21sleep09:30:013
3631932991614,1cyclictest0-21swapper/312:25:003
3631932991613,1cyclictest0-21swapper/309:55:143
363193299161,11cyclictest4027649-21taskset12:15:143
363193299161,11cyclictest3976600-21taskset11:35:153
363193299159,4cyclictest3952688-21taskset11:15:153
363193299157,6cyclictest3802048-21turbostat09:20:003
3631932991513,1cyclictest0-21swapper/307:50:003
3631932991513,0cyclictest0-21swapper/308:35:383
3631932991512,1cyclictest0-21swapper/312:11:523
3631932991512,1cyclictest0-21swapper/310:40:263
3631932991512,1cyclictest0-21swapper/309:35:143
3631932991512,1cyclictest0-21swapper/308:43:023
3631932991512,1cyclictest0-21swapper/307:22:283
363193299151,11cyclictest3930882-21taskset11:00:023
363193299151,10cyclictest3775393-21taskset08:55:243
36314182150,3sleep30-21swapper/307:05:273
3631932991412,1cyclictest0-21swapper/311:45:253
3631932991412,1cyclictest0-21swapper/311:30:373
3631932991412,1cyclictest0-21swapper/310:37:573
3631932991412,1cyclictest0-21swapper/307:39:483
3631932991412,1cyclictest0-21swapper/307:20:003
3631932991411,1cyclictest0-21swapper/310:55:003
3631932991411,1cyclictest0-21swapper/310:30:013
3631932991411,1cyclictest0-21swapper/309:40:163
3631932991411,1cyclictest0-21swapper/308:30:433
3631932991411,1cyclictest0-21swapper/308:10:143
3631932991411,1cyclictest0-21swapper/307:55:233
363193299141,10cyclictest3995457-21chrt11:50:013
363193299141,10cyclictest3859826-21turbostat10:05:013
363193299141,10cyclictest3859826-21turbostat10:05:003
3631932991410,1cyclictest0-21swapper/311:10:113
363193299140,10cyclictest4045736-21taskset12:25:193
363193299140,10cyclictest4045736-21taskset12:25:193
40456772130,5sleep24045735-21ntp_states12:25:192
40456772130,5sleep24045735-21ntp_states12:25:192
39826682132,7sleep13982701-21apt-get11:40:141
39140892131,3sleep13916205-21grep10:45:171
37976052131,9sleep13799646-21cut09:15:191
37243702131,4sleep13724441-21wc08:20:001
363193299135,6cyclictest3704982-21taskset08:02:513
363193299134,7cyclictest3962272-21taskset11:20:213
363193299134,7cyclictest3769515-21taskset08:53:273
363193299134,7cyclictest3660079-21taskset07:29:493
363193299131,9cyclictest4046871-21taskset12:30:123
363193299131,9cyclictest4020144-21taskset12:05:203
363193299131,9cyclictest3937652-21taskset11:05:013
363193299131,9cyclictest3834418-21taskset09:45:123
363193299131,9cyclictest3789421-21taskset09:10:063
363193299131,9cyclictest3788807-21taskset09:05:253
363193299131,9cyclictest3729579-21taskset08:20:193
363193299131,8cyclictest3879339-21chrt10:20:103
3631932991312,0cyclictest0-21swapper/311:28:483
363193299131,10cyclictest3866265-21taskset10:10:003
3631932991311,0cyclictest0-21swapper/309:34:383
3631932991310,1cyclictest0-21swapper/308:06:393
39249432121,9sleep03925660-21cut10:55:180
37310852121,7sleep13731118-21apt-get08:25:131
363193299121,9cyclictest3763035-21taskset08:47:353
363193299121,9cyclictest3679215-21taskset07:41:243
363193299121,9cyclictest3679215-21taskset07:41:233
3631932991211,0cyclictest0-21swapper/308:27:593
3631932991210,1cyclictest0-21swapper/309:51:023
363193299120,9cyclictest3776599-21chrt09:00:013
363193299120,10cyclictest3911667-21taskset10:45:023
301798120,7rtkit-daemon3840344-21taskset09:47:271
301798120,11rtkit-daemon3016-21rtkit-daemon11:35:201
40458302110,1sleep00-21swapper/012:25:210
40458302110,1sleep00-21swapper/012:25:200
40032772110,8sleep04004402-21cut11:55:160
37632252111,7sleep03763268-21munin-run08:50:010
37108232111,7sleep23710988-21timerwakeupswit08:05:242
363193299110,9cyclictest3686354-21chrt07:50:123
301798110,6rtkit-daemon3866510-21apt-get10:10:121
301798110,6rtkit-daemon3853703-21apt-get10:00:121
301798110,6rtkit-daemon3853703-21apt-get10:00:121
37818772101,5sleep23781936-21ntp_states09:00:212
37770092104,3sleep13777397-21sed09:00:161
37183802101,6sleep03718541-21cut08:15:150
36925792101,4sleep13692612-21apt-get07:55:131
301798100,7rtkit-daemon636-21snmpd07:21:410
301798100,6rtkit-daemon636-21snmpd08:26:490
301798100,6rtkit-daemon3693779-21sed07:55:170
301798100,6rtkit-daemon3679364-21taskset07:43:180
301798100,6rtkit-daemon3679364-21taskset07:43:180
301798100,6rtkit-daemon317-21systemd-udevd12:23:331
301798100,3rtkit-daemon430-21avahi-daemon09:26:261
301798100,3rtkit-daemon3200908-21packagekitd08:38:390
301798100,1rtkit-daemon0-21swapper/008:04:100
4027613291,4sleep24027646-21apt-get12:15:142
4026458291,4sleep24026517-21ntp_states12:10:212
3939991290,6sleep13942088-21kthreadcore11:05:171
3930992291,4sleep03931024-21apt-get11:00:150
3924567290,6sleep13924532-21/usr/sbin/munin10:55:161
3892150291,5sleep23892306-21diskstats10:30:162
3892125291,4sleep13892147-21apt-get10:30:161
3653632291,6sleep23653639-21latency_hist07:25:002
30179890,6rtkit-daemon3205-21sendmail-mta09:30:241
30179890,5rtkit-daemon3205-21sendmail-mta12:19:401
30179890,4rtkit-daemon3783483-21cat09:05:151
30179890,4rtkit-daemon3756501-21chrt08:41:180
30179890,4rtkit-daemon3654067-21grep07:25:130
4053669280,5sleep14054218-21irqrtprio12:35:161
4014780281,3sleep14014813-21apt-get12:05:111
3950515281,3sleep13950548-21apt-get11:15:101
3918090282,3sleep13918123-21apt-get10:50:101
3848663281,4sleep13849877-21grep09:55:181
3821557280,4sleep03821590-21apt-get09:35:120
3808710281,2sleep20-21swapper/209:25:102
3801296281,4sleep23801430-21sed09:15:232
3762383280,5sleep13762484-21basename08:45:211
3724184280,6sleep23724185-21sshd08:17:372
3685910280,5sleep23686062-21sed07:50:002
30179880,5rtkit-daemon636-21snmpd12:10:211
30179880,5rtkit-daemon3638541-21munin-node08:11:530
30179880,4rtkit-daemon667-21lldpd09:24:441
30179880,4rtkit-daemon636-21snmpd10:17:261
30179880,4rtkit-daemon636-21snmpd09:38:061
30179880,4rtkit-daemon636-21snmpd07:47:050
30179880,4rtkit-daemon636-21snmpd07:16:310
30179880,4rtkit-daemon492-21gmain10:23:321
30179880,4rtkit-daemon448-21wpa_supplicant11:56:561
30179880,4rtkit-daemon448-21wpa_supplicant07:37:340
30179880,4rtkit-daemon430-21avahi-daemon11:20:031
30179880,4rtkit-daemon430-21avahi-daemon08:22:050
30179880,4rtkit-daemon413-21rpcbind09:12:361
30179880,4rtkit-daemon4008070-21cron12:00:001
30179880,4rtkit-daemon3638541-21munin-node12:26:051
30179880,4rtkit-daemon3638541-21munin-node12:26:041
30179880,4rtkit-daemon3638541-21munin-node10:07:411
30179880,4rtkit-daemon3592745-21munin-node07:12:390
30179880,4rtkit-daemon3559988-21kworker/0:1+kacpid08:31:410
30179880,4rtkit-daemon3200908-21packagekitd11:26:481
30179880,4rtkit-daemon3200908-21packagekitd09:51:081
30179880,3rtkit-daemon3975993-21munin-run11:35:001
30179880,1rtkit-daemon0-21swapper/111:50:031
30179880,1rtkit-daemon0-21swapper/111:14:221
30179880,1rtkit-daemon0-21swapper/110:40:211
30179880,1rtkit-daemon0-21swapper/109:40:401
30179880,1rtkit-daemon0-21swapper/008:51:540
30179880,1rtkit-daemon0-21swapper/008:06:430
30179880,1rtkit-daemon0-21swapper/007:52:280
4014526271,3sleep24014545-21munin-run12:05:012
3981491270,4sleep03981547-21ntp_states11:35:210
3963567271,3sleep03963680-21fw_packets11:25:160
3955960270,4sleep03956144-21sed11:15:210
3937700270,4sleep03937844-21df11:05:120
3937245270,3sleep23937161-21apt-get11:05:012
3930710270,5sleep20-21swapper/211:00:022
3907382270,5sleep03909475-21kthreadcore10:40:190
3892466271,3sleep03892620-21cut10:30:190
3839641270,1sleep20-21swapper/209:45:202
3827995270,3sleep03828027-21apt-get09:40:130
3820535271,4sleep03815144-21/usr/sbin/munin09:30:240
3769894271,2sleep00-21swapper/008:55:130
3769634270,4sleep23769635-21cron08:54:592
3737971271,3sleep13738966-21irqstats08:30:181
3726102270,4sleep13727426-21cut08:20:181
3685097270,4sleep13679752-21/usr/sbin/munin07:45:231
3673341270,3sleep13673374-21apt-get07:40:151
3673341270,3sleep13673374-21apt-get07:40:141
3669480270,4sleep13671611-21kthreadcore07:35:171
3659377270,4sleep13659505-21cat07:25:231
30179870,4rtkit-daemon636-21snmpd10:38:201
30179870,4rtkit-daemon430-21avahi-daemon07:33:140
30179870,3rtkit-daemon676-21runrttasks07:05:100
30179870,3rtkit-daemon636-21snmpd09:00:110
30179870,3rtkit-daemon3936735-21unixbench_singl11:00:261
30179870,3rtkit-daemon3638541-21munin-node10:25:031
30179870,3rtkit-daemon3205-21sendmail-mta11:45:041
4054599260,4sleep24055769-21kthreadcore12:35:182
4030310260,3sleep04032463-21cut12:15:190
4018948261,3sleep04014781-21/usr/sbin/munin12:05:190
4002136261,2sleep20-21swapper/211:55:142
3997761261,3sleep03999856-21kthreadcore11:50:200
3995929261,2sleep20-21swapper/211:50:172
3979902260,4sleep23981350-21cut11:35:202
3975591263,1sleep20-21swapper/211:30:262
3963843260,3sleep23964830-21irqstats11:25:172
3956936261,2sleep20-21swapper/211:20:132
3918126260,1sleep20-21swapper/210:50:112
3911150260,1sleep20-21swapper/210:41:302
3885716261,3sleep2636-21snmpd10:25:112
3882060260,4sleep03884224-21kthreadcore10:20:160
3878708260,1sleep00-21swapper/010:15:550
3861555260,4sleep03863460-21cut10:05:180
3853048260,1sleep20-21swapper/209:55:382
3826888260,1sleep20-21swapper/209:35:222
3802313261,2sleep20-21swapper/209:20:122
3801772260,1sleep00-21swapper/009:16:460
3789844260,4sleep03790599-21cut09:10:160
3775307260,4sleep20-21swapper/208:55:242
3769930260,3sleep13769895-21/usr/sbin/munin08:55:141
3752137261,2sleep13754148-21grep08:40:201
3744402261,2sleep10-21swapper/108:35:161
3738967261,2sleep20-21swapper/208:30:192
3732542261,2sleep20-21swapper/208:25:182
3711811260,1sleep10-21swapper/108:10:151
3711355260,1sleep10-21swapper/108:07:541
3698564260,1sleep20-21swapper/207:57:462
3686165261,1sleep10-21swapper/107:50:111
3660352261,2sleep13660385-21apt-get07:30:121
3650196260,4sleep13652350-21kthreadcore07:20:191
3638842260,3sleep13640455-21cut07:15:011
3625679260,2sleep20-21swapper/207:05:142
30179860,3rtkit-daemon3205-21sendmail-mta12:31:191
4059047250,1sleep00-21swapper/012:35:390
4047304250,3sleep20-21swapper/212:30:162
4040092250,1sleep20-21swapper/212:23:472
4034030250,2sleep00-21swapper/012:20:120
4027302250,3sleep00-21swapper/012:14:190
3994943250,1sleep00-21swapper/011:46:310
3990532250,2sleep23991884-21kthreadcore11:45:162
3988727250,1sleep00-21swapper/011:43:460
3951524251,2sleep20-21swapper/211:15:152
3950226250,1sleep00-21swapper/011:14:340
3948347250,2sleep20-21swapper/211:10:182
3924032250,1sleep00-21swapper/010:51:530
3904719250,1sleep20-21swapper/210:36:492
3899231251,2sleep00-21swapper/010:35:140
3891658250,3sleep00-21swapper/010:27:290
3879303250,2sleep20-21swapper/210:20:102
3873963251,2sleep20-21swapper/210:15:182
3872599250,1sleep00-21swapper/010:14:510
3859591250,1sleep00-21swapper/010:02:130
3859591250,1sleep00-21swapper/010:02:130
3859525250,1sleep20-21swapper/210:01:242
3859525250,1sleep20-21swapper/210:01:232
3841787251,2sleep20-21swapper/209:50:172
3834575251,2sleep00-21swapper/009:45:140
3834088250,1sleep20-21swapper/209:44:332
3820986250,1sleep20-21swapper/209:30:582
3788866250,1sleep20-21swapper/209:06:092
3783029250,2sleep00-21swapper/009:05:110
3762882250,1sleep20-21swapper/208:45:392
3750237250,1sleep20-21swapper/208:38:292
3730608250,1sleep20-21swapper/208:22:112
3717809250,1sleep20-21swapper/208:13:282
3705097250,1sleep10-21swapper/108:04:221
3692029250,1sleep20-21swapper/207:51:132
3674524251,2sleep23675631-21kthreadcore07:40:202
3674524251,2sleep23675631-21kthreadcore07:40:192
3672850250,1sleep20-21swapper/207:38:342
3659852250,3sleep20-21swapper/207:26:522
3640456250,2sleep20-21swapper/207:15:022
4052204240,1sleep00-21swapper/012:30:220
4015771240,2sleep20-21swapper/212:05:162
4014476240,3sleep00-21swapper/012:04:220
3917623240,3sleep20-21swapper/210:47:142
3866477241,1sleep20-21swapper/210:10:122
3860062240,2sleep23860082-21acpi10:05:112
3847210240,1sleep00-21swapper/009:55:130
3846654240,3sleep00-21swapper/009:51:070
3814528240,3sleep00-21swapper/009:25:270
3802495240,2sleep00-21swapper/009:20:140
3795302240,3sleep20-21swapper/209:11:222
3756446240,3sleep20-21swapper/208:40:372
3704047240,2sleep23704219-21strings08:00:182
3661344240,2sleep20-21swapper/207:30:182
3637469240,3sleep20-21swapper/207:10:222
3625954240,1sleep10-21swapper/107:05:171
3988468230,1sleep20-21swapper/211:40:272
3969813230,1sleep00-21swapper/011:30:120
3962350230,1sleep00-21swapper/011:20:220
3931183230,1sleep20-21swapper/211:00:172
3912928230,1sleep00-21swapper/010:45:170
3766038230,1sleep10-21swapper/108:50:181
3631775230,1sleep10-21swapper/107:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional