You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-21 - 08:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Sun Dec 21, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
38550169911540,1149cyclictest3954037-21sleep20:25:003
38550169910040,998cyclictest3986397-21sleep20:50:013
41844452280,1sleep20-21swapper/223:20:202
385501699198,8cyclictest18856-21turbostat23:45:013
3855016991815,1cyclictest0-21swapper/319:40:003
41035182172,4sleep04103532-21apt-get22:20:130
3855016991714,1cyclictest0-21swapper/323:35:013
3855016991714,1cyclictest0-21swapper/319:15:253
385501699171,13cyclictest4148491-21taskset22:55:013
385501699162,10cyclictest4013154-21taskset21:10:113
3855016991614,1cyclictest0-21swapper/321:34:593
3855016991613,1cyclictest0-21swapper/320:20:003
3855016991613,1cyclictest0-21swapper/300:30:183
41805662151,4sleep24180631-21munin-run23:20:012
3855016991513,0cyclictest0-21swapper/319:59:583
3855016991512,1cyclictest0-21swapper/322:39:463
3855016991512,1cyclictest0-21swapper/320:45:013
385501699151,11cyclictest4051451-21taskset21:40:003
385501699151,11cyclictest3938635-21taskset20:10:203
385501699151,10cyclictest4026030-21taskset21:20:133
385501699141,9cyclictest643492sleep300:20:123
3855016991413,0cyclictest0-21swapper/321:58:373
3855016991412,1cyclictest0-21swapper/323:59:263
3855016991412,1cyclictest0-21swapper/323:46:313
3855016991412,1cyclictest0-21swapper/322:41:083
3855016991412,1cyclictest0-21swapper/320:08:043
3855016991412,1cyclictest0-21swapper/319:52:343
3855016991412,1cyclictest0-21swapper/319:14:563
3855016991412,1cyclictest0-21swapper/300:03:583
3855016991412,0cyclictest0-21swapper/320:29:453
3855016991412,0cyclictest0-21swapper/300:25:203
385501699141,11cyclictest3876644-21taskset19:25:013
3855016991411,1cyclictest0-21swapper/323:29:183
3855016991411,1cyclictest0-21swapper/323:10:423
3855016991411,1cyclictest0-21swapper/323:07:453
3855016991411,1cyclictest0-21swapper/321:29:273
385501699141,10cyclictest4155127-21chrt23:00:013
385501699141,10cyclictest4084222-21taskset22:05:163
385501699141,10cyclictest4057207-21taskset21:40:243
385501699141,10cyclictest3986922-21taskset20:50:113
385501699141,10cyclictest3961065-21taskset20:30:163
385501699141,10cyclictest3902136-21taskset19:41:443
385501699141,10cyclictest3888744-21taskset19:30:253
385501699134,7cyclictest4186825-21taskset23:23:053
385501699134,6cyclictest40970132sleep322:15:153
385501699131,9cyclictest4174415-21taskset23:15:123
385501699131,9cyclictest4154539-21chrt22:55:533
385501699131,9cyclictest4141697-21taskset22:45:583
385501699131,9cyclictest4077335-21chrt22:00:073
385501699131,9cyclictest4012626-21sleep21:10:013
385501699131,9cyclictest3999849-21taskset21:00:133
385501699131,9cyclictest3967036-21taskset20:35:013
385501699131,9cyclictest30968-21taskset23:50:183
3855016991312,0cyclictest0-21swapper/322:20:343
3855016991312,0cyclictest0-21swapper/320:02:103
3855016991311,1cyclictest0-21swapper/321:50:003
3855016991311,1cyclictest0-21swapper/321:17:583
385501699131,10cyclictest4122502-21taskset22:31:333
385501699131,10cyclictest3993352-21chrt20:55:123
3855016991310,1cyclictest0-21swapper/321:50:183
385501699130,5cyclictest0-21swapper/322:25:133
385501699130,5cyclictest0-21swapper/322:25:133
385501699130,10cyclictest7681-21taskset23:35:193
385501699130,10cyclictest63746-21chrt00:15:543
53832120,4sleep05600-21users23:30:240
39081372120,5sleep13908300-21cat19:45:241
385501699121,9cyclictest89702-21taskset00:35:573
385501699121,9cyclictest50576-21taskset00:05:233
385501699121,9cyclictest4096341-21taskset22:12:083
385501699121,8cyclictest3870229-21taskset19:20:013
3855016991211,0cyclictest0-21swapper/300:10:173
385501699120,9cyclictest3908481-21taskset19:45:333
38545842120,3sleep30-21swapper/319:06:313
38487602121,6sleep03848793-21apt-get19:05:120
301798110,7rtkit-daemon4161430-21ls23:05:001
301798110,6rtkit-daemon3883111-21apt-get19:30:141
301798110,4rtkit-daemon492-21gmain22:22:191
40904312101,2sleep20-21swapper/222:10:132
39140002100,1sleep10-21swapper/119:50:201
38755882101,6sleep03875713-21smart_sda19:20:230
301798100,6rtkit-daemon4055299-21cut21:40:191
301798100,5rtkit-daemon4036040-21kthreadcore21:25:211
301798100,5rtkit-daemon4013420-21perl21:10:131
301798100,3rtkit-daemon63773-21pool-udisksd00:16:292
301798100,2rtkit-daemon0-21swapper/200:10:422
77864291,5sleep278637-21sed00:30:162
46540290,6sleep147826-21grep00:05:191
4149696290,6sleep04150872-21cut22:55:190
4032411291,4sleep04032444-21apt-get21:25:150
4031337291,4sleep04031462-21python321:20:220
3943179290,6sleep13945285-21grep20:15:211
3927474290,3sleep13927683-21grep20:00:251
30179890,6rtkit-daemon667-21lldpd23:30:302
30179890,5rtkit-daemon3205-21sendmail-mta23:29:242
30179890,5rtkit-daemon3205-21sendmail-mta21:48:341
30179890,5rtkit-daemon317-21systemd-udevd22:25:331
30179890,5rtkit-daemon317-21systemd-udevd22:25:321
30179890,5rtkit-daemon317-21systemd-udevd20:07:331
30179890,5rtkit-daemon317-21systemd-udevd19:11:331
30179890,4rtkit-daemon4004468-21cut21:00:191
30179890,4rtkit-daemon3893225-21kthreadcore19:35:191
30179890,1rtkit-daemon0-21swapper/123:09:301
30179890,1rtkit-daemon0-21swapper/121:23:101
30179890,1rtkit-daemon0-21swapper/121:08:041
4187675281,4sleep14188433-21cut23:25:171
4180884281,4sleep14181040-21diskstats23:20:161
4148447281,4sleep21-21systemd22:55:012
4128343280,6sleep04128418-21ps22:35:220
3980646281,4sleep03981641-21irqstats20:45:170
3975278280,6sleep23977353-21cut20:40:182
3947289280,5sleep01-21systemd20:20:010
3915500281,4sleep13915533-21apt-get19:55:131
3889232280,5sleep03889245-21apt-get19:35:000
3854042280,4sleep23854167-21python319:05:212
30179880,4rtkit-daemon88026-21kthreadcore00:35:172
30179880,4rtkit-daemon667-21lldpd21:50:131
30179880,4rtkit-daemon667-21lldpd20:21:241
30179880,4rtkit-daemon667-21lldpd19:40:231
30179880,4rtkit-daemon667-21lldpd19:26:561
30179880,4rtkit-daemon636-21snmpd22:58:281
30179880,4rtkit-daemon636-21snmpd22:30:131
30179880,4rtkit-daemon636-21snmpd21:57:021
30179880,4rtkit-daemon636-21snmpd21:30:071
30179880,4rtkit-daemon448-21wpa_supplicant23:37:082
30179880,4rtkit-daemon3861546-21munin-node00:05:072
30179880,4rtkit-daemon37419-21/usr/sbin/munin23:55:202
30179880,4rtkit-daemon3205-21sendmail-mta23:51:162
30179880,4rtkit-daemon3205-21sendmail-mta20:45:111
30179880,4rtkit-daemon3200908-21packagekitd20:30:411
30179880,4rtkit-daemon12999-21head23:40:142
30179880,3rtkit-daemon3988178-21irqrtprio20:50:161
30179880,1rtkit-daemon0-21swapper/122:41:511
30179880,1rtkit-daemon0-21swapper/119:19:431
25491280,5sleep025517-21awk23:50:000
83581270,4sleep183593-21latency_hist00:35:001
79767270,4sleep081894-21kthreadcore00:30:180
59424270,5sleep161359-21kthreadcore00:15:171
4192668271,3sleep04192789-21ls23:25:240
4129877271,3sleep00-21swapper/022:40:160
4123227271,4sleep14123428-21/usr/sbin/munin22:35:161
4097618272,2sleep14098577-21kthreadcore22:15:171
4070647270,4sleep04070886-21latency_hist21:55:000
4056925270,1sleep00-21swapper/021:40:220
4025133271,4sleep04025346-21users21:15:260
40060271,3sleep241534-21cut00:00:192
3993391271,3sleep23993540-21df_inode20:55:162
3993355271,2sleep10-21swapper/120:55:151
3986392271,3sleep03986383-21apt-get20:50:020
3940264270,4sleep03940508-21users20:10:270
3935701270,4sleep13936603-21grep20:10:201
3933358270,4sleep23933425-21memory20:05:202
3927200270,4sleep23927256-21ntp_states20:00:232
3904894270,4sleep03907011-21cut19:45:190
3903077270,5sleep23903705-21irqrtprio19:45:162
3882140270,5sleep03882387-21unixbench_multi19:25:270
30179870,4rtkit-daemon638-21ntpd22:53:081
30179870,4rtkit-daemon638-21ntpd20:25:031
30179870,4rtkit-daemon636-21snmpd19:05:031
30179870,4rtkit-daemon492-21gmain23:45:422
30179870,4rtkit-daemon430-21avahi-daemon19:20:021
30179870,4rtkit-daemon3200908-21packagekitd22:48:411
30179870,4rtkit-daemon3200908-21packagekitd20:42:501
30179870,3rtkit-daemon638-21ntpd23:13:211
30179870,3rtkit-daemon638-21ntpd22:06:341
30179870,3rtkit-daemon636-21snmpd00:25:082
30179870,3rtkit-daemon636-21snmpd00:20:232
30179870,3rtkit-daemon3861546-21munin-node22:10:181
30179870,3rtkit-daemon3861546-21munin-node22:00:271
30179870,3rtkit-daemon3861546-21munin-node21:16:271
30179870,3rtkit-daemon3205-21sendmail-mta23:15:061
30179870,3rtkit-daemon3205-21sendmail-mta20:35:261
30179870,1rtkit-daemon0-21swapper/121:35:161
27205271,3sleep00-21swapper/023:50:160
76602260,1sleep00-21swapper/000:26:140
70765260,2sleep170798-21apt-get00:25:151
64386262,2sleep064519-21tr00:20:130
63150260,4sleep063225-21sh00:15:200
51521260,3sleep151554-21apt-get00:10:121
4160488260,3sleep24160613-21python323:00:242
4141400261,3sleep04141644-21users22:45:250
4110910260,3sleep04112101-21cut22:25:180
4110910260,3sleep04112101-21cut22:25:180
4102957260,3sleep04103362-21sed22:20:010
4065500261,3sleep20-21swapper/221:50:182
4051394260,3sleep24051423-21munin-run21:40:002
3998218260,3sleep03998606-21needreboot20:55:220
3986886261,2sleep20-21swapper/220:50:122
3980373261,2sleep20-21swapper/220:45:152
3959511261,3sleep03959567-21ntp_states20:25:250
3953191260,3sleep03953296-21systemctl20:20:250
3947842261,1sleep20-21swapper/220:20:152
3911810261,3sleep03913997-21cut19:50:200
3909086261,2sleep20-21swapper/219:50:142
3870245261,2sleep20-21swapper/219:20:132
3863785260,3sleep03863818-21apt-get19:15:140
15391261,3sleep017562-21tr23:40:180
1010261,2sleep10-21swapper/123:30:171
89670250,1sleep10-21swapper/100:35:321
83838250,2sleep00-21swapper/000:35:100
66555250,2sleep167495-21kthreadcore00:20:171
57615250,1sleep00-21swapper/000:14:120
44649250,1sleep00-21swapper/000:02:460
4186086251,2sleep00-21swapper/023:20:230
4180438253,1sleep0376-21hwrng23:18:210
4169448251,2sleep00-21swapper/023:10:170
4167978250,1sleep20-21swapper/223:10:032
4165407250,3sleep04166702-21memory23:05:200
4156126250,3sleep04157089-21kthreadcore23:00:190
4154507250,1sleep20-21swapper/222:55:292
4138019251,2sleep20-21swapper/222:45:192
4128921250,1sleep20-21swapper/222:36:372
4116581250,1sleep00-21swapper/022:30:060
4115990250,1sleep20-21swapper/222:29:002
4115990250,1sleep20-21swapper/222:28:592
4079998250,2sleep00-21swapper/022:00:160
4077341250,2sleep20-21swapper/222:00:112
4070905250,2sleep00-21swapper/021:55:120
4063420250,2sleep00-21swapper/021:45:230
4057583250,1sleep20-21swapper/221:42:002
4045262250,2sleep00-21swapper/021:35:130
4039027250,3sleep04039229-21smartctl21:30:160
4025994250,2sleep20-21swapper/221:20:132
4021393251,2sleep20-21swapper/221:15:202
4013118250,2sleep20-21swapper/221:10:112
4012597250,2sleep04012726-21gpgv21:10:010
4006664250,3sleep20-21swapper/221:05:132
4000275251,2sleep20-21swapper/221:00:172
3973889250,3sleep03974354-21cut20:40:150
3972906251,2sleep20-21swapper/220:36:092
3968545251,2sleep00-21swapper/020:35:190
3966720250,3sleep00-21swapper/020:34:030
3966553250,1sleep20-21swapper/220:31:572
3946948250,1sleep20-21swapper/220:15:422
3934411250,1sleep00-21swapper/020:09:230
3921592250,1sleep20-21swapper/219:59:112
39066250,3sleep138602-21/usr/sbin/munin00:00:181
3896249250,3sleep03896392-21df19:40:140
3885907250,2sleep03888112-21grep19:30:200
3881976250,2sleep23882051-21ps19:25:252
3861074250,1sleep00-21swapper/019:11:090
3861051250,1sleep20-21swapper/219:10:512
37978250,1sleep10-21swapper/123:55:541
31882250,1sleep10-21swapper/123:54:581
21055251,2sleep10-21swapper/123:45:201
18769250,1sleep10-21swapper/123:44:071
12193250,1sleep10-21swapper/123:37:191
6414240,2sleep00-21swapper/023:35:170
45087240,1sleep00-21swapper/000:05:140
4162431240,2sleep20-21swapper/223:05:182
4131776240,2sleep20-21swapper/222:40:182
4116590240,1sleep20-21swapper/222:30:122
4109329240,3sleep20-21swapper/222:20:512
4102611240,3sleep20-21swapper/222:15:382
4096393240,3sleep00-21swapper/022:12:510
4077000240,3sleep20-21swapper/221:59:112
4059532240,2sleep20-21swapper/221:45:162
4038862240,3sleep20-21swapper/221:30:142
4038321240,2sleep20-21swapper/221:26:542
4019081240,3sleep00-21swapper/021:12:130
3936605240,2sleep20-21swapper/220:10:212
3915700240,1sleep00-21swapper/019:55:160
3895613240,3sleep20-21swapper/219:35:552
33124240,2sleep00-21swapper/023:55:160
4142272230,1sleep00-21swapper/022:50:140
4089487230,1sleep00-21swapper/022:05:260
4085046230,1sleep20-21swapper/222:05:202
4000002230,1sleep00-21swapper/021:00:150
3954474230,1sleep20-21swapper/220:25:182
3921930230,1sleep00-21swapper/020:00:080
3896204230,1sleep20-21swapper/219:40:082
3883078230,1sleep20-21swapper/219:30:142
3866573230,1sleep20-21swapper/219:15:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional