You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 18:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Tue May 26, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1239599280,24cyclictest0-21swapper/111:17:561
1239599270,27cyclictest0-21swapper/109:39:291
1239599270,26cyclictest6551-21diskmemload11:56:431
1239599270,1cyclictest17912-21munin-run10:45:011
1239599270,1cyclictest0-21swapper/111:48:101
1239899250,24cyclictest6551-21diskmemload10:16:433
1239899250,24cyclictest6551-21diskmemload09:54:263
1239799250,24cyclictest6551-21diskmemload09:13:212
1239799250,24cyclictest16959-21cron08:25:012
1239799250,24cyclictest0-21swapper/210:11:152
1239799250,24cyclictest0-21swapper/209:43:252
12395992523,2cyclictest0-21swapper/111:06:031
12395992521,4cyclictest0-21swapper/107:43:071
12395992520,4cyclictest0-21swapper/109:58:071
1239599250,24cyclictest22602-21rm10:21:101
1239599250,24cyclictest0-21swapper/110:58:081
1239599250,24cyclictest0-21swapper/109:50:391
1239599250,24cyclictest0-21swapper/109:27:141
1239599250,21cyclictest6947-21ssh12:29:061
1239599250,1cyclictest0-21swapper/110:00:071
1239599250,1cyclictest0-21swapper/109:48:091
12394992523,1cyclictest13145-21ssh10:41:250
12394992523,1cyclictest12444-21ssh12:33:520
1239499250,24cyclictest12840-21ssh09:15:240
12398992423,1cyclictest24541-21ssh09:25:433
12398992423,1cyclictest0-21swapper/311:52:563
12398992422,2cyclictest10108-21ssh09:42:033
12398992422,1cyclictest28428-21sh10:26:243
1239899240,23cyclictest9405-21ssh12:32:073
1239899240,23cyclictest6551-21diskmemload11:13:113
1239899240,23cyclictest29106-21sh12:20:133
1239899240,23cyclictest29106-21sh12:20:133
1239899240,1cyclictest15130-21ssh12:37:123
1239799240,23cyclictest8272-21awk11:05:012
1239799240,23cyclictest0-21swapper/209:35:082
1239799240,1cyclictest0-21swapper/211:43:122
1239799240,1cyclictest0-21swapper/211:15:302
1239799240,0cyclictest0-21swapper/210:33:482
12395992421,2cyclictest28623-21ssh11:51:501
12395992420,3cyclictest0-21swapper/110:36:181
12395992420,3cyclictest0-21swapper/110:06:011
1239599240,24cyclictest0-21swapper/112:18:401
1239599240,24cyclictest0-21swapper/109:12:201
1239599240,23cyclictest0-21swapper/111:01:091
1239599240,23cyclictest0-21swapper/109:23:001
1239599240,21cyclictest0-21swapper/112:02:581
1239599240,20cyclictest0-21swapper/110:33:231
1239599240,20cyclictest0-21swapper/110:15:141
1239599240,0cyclictest0-21swapper/111:33:571
1239599240,0cyclictest0-21swapper/111:10:311
12394992423,1cyclictest32717-21ssh10:29:510
1239499240,24cyclictest6551-21diskmemload11:43:170
1239499240,23cyclictest6987-21ssh09:10:140
1239499240,23cyclictest2639-21diskmemload09:34:530
1239499240,1cyclictest6551-21diskmemload09:35:560
12398992323,0cyclictest0-21swapper/311:37:563
12398992323,0cyclictest0-21swapper/310:33:283
12398992322,1cyclictest6551-21diskmemload11:47:443
12398992321,1cyclictest4240-21ptp4l11:58:153
1239899230,23cyclictest0-21swapper/312:08:033
1239899230,23cyclictest0-21swapper/311:40:223
1239899230,23cyclictest0-21swapper/310:45:033
1239899230,23cyclictest0-21swapper/310:37:293
1239899230,23cyclictest0-21swapper/310:08:373
1239899230,23cyclictest0-21swapper/309:59:513
1239899230,23cyclictest0-21swapper/309:10:553
1239899230,22cyclictest6551-21diskmemload09:31:453
1239899230,22cyclictest6551-21diskmemload09:21:443
1239899230,22cyclictest3182-21ssh11:00:253
1239899230,22cyclictest28384-21rm12:19:403
1239899230,22cyclictest27860-21/usr/sbin/munin11:23:163
1239899230,0cyclictest6551-21diskmemload12:25:373
1239899230,0cyclictest0-21swapper/309:47:333
12397992323,0cyclictest6551-21diskmemload09:27:562
12397992323,0cyclictest0-21swapper/209:50:002
12397992321,1cyclictest0-21swapper/210:21:382
12397992320,3cyclictest0-21swapper/212:34:392
12397992320,2cyclictest8154-21sh12:02:392
12397992320,2cyclictest31743-21ssh09:32:482
12397992320,2cyclictest12526-21ssh10:40:392
12397992320,1cyclictest0-21swapper/211:34:192
1239799230,23cyclictest6551-21diskmemload12:20:442
1239799230,23cyclictest6551-21diskmemload12:20:442
1239799230,23cyclictest0-21swapper/212:17:132
1239799230,23cyclictest0-21swapper/210:58:162
1239799230,23cyclictest0-21swapper/209:54:362
1239799230,22cyclictest6551-21diskmemload09:57:242
1239799230,22cyclictest32512-21ssh11:26:392
1239799230,22cyclictest27708-21ssh10:25:182
1239799230,22cyclictest1774-21perf09:00:002
1239799230,22cyclictest12118-21ssh12:05:152
1239799230,22cyclictest0-21swapper/210:52:192
1239799230,21cyclictest0-21swapper/211:11:142
1239799230,0cyclictest6551-21diskmemload10:38:052
1239799230,0cyclictest6551-21diskmemload10:01:522
1239799230,0cyclictest0-21swapper/211:53:072
12395992323,0cyclictest0-21swapper/110:26:161
12395992323,0cyclictest0-21swapper/109:34:261
12395992323,0cyclictest0-21swapper/108:58:071
12395992321,1cyclictest0-21swapper/112:11:381
12395992321,1cyclictest0-21swapper/111:40:311
12395992321,1cyclictest0-21swapper/107:35:001
1239599230,23cyclictest0-21swapper/112:33:241
1239599230,23cyclictest0-21swapper/111:25:391
1239599230,23cyclictest0-21swapper/109:15:071
1239599230,1cyclictest606-21dbus-daemon07:50:011
1239599230,1cyclictest0-21swapper/111:20:261
1239599230,0cyclictest0-21swapper/111:39:391
1239599230,0cyclictest0-21swapper/110:45:571
1239599230,0cyclictest0-21swapper/109:42:251
12394992323,0cyclictest6551-21diskmemload12:01:030
12394992323,0cyclictest0-21swapper/012:20:580
12394992323,0cyclictest0-21swapper/012:20:580
12394992323,0cyclictest0-21swapper/011:13:470
12394992322,1cyclictest6551-21diskmemload11:52:190
12394992322,1cyclictest6551-21diskmemload11:16:000
12394992320,2cyclictest5496-21sh10:06:040
12394992320,2cyclictest5156-21sh10:33:430
12394992320,2cyclictest0-21swapper/009:21:260
1239499230,2cyclictest15184-21ssh10:14:170
1239499230,23cyclictest62550irq/127-eno112:15:290
1239499230,23cyclictest0-21swapper/011:03:160
1239499230,23cyclictest0-21swapper/009:52:420
1239499230,23cyclictest0-21swapper/009:45:040
1239499230,23cyclictest0-21swapper/009:29:050
1239499230,22cyclictest6031-21sendmail-msp12:00:000
1239499230,22cyclictest26605-21rm09:56:160
1239499230,22cyclictest24830-21munin-plugin-st07:35:000
1239499230,22cyclictest11910-21latency_hist10:40:000
1239499230,1cyclictest24735-21sh10:51:070
1239499230,1cyclictest0-21swapper/011:45:110
1239499230,0cyclictest6551-21diskmemload10:15:490
1239499230,0cyclictest0-21swapper/010:46:270
1239499230,0cyclictest0-21swapper/010:22:020
12398992222,0cyclictest0-21swapper/310:41:403
12398992221,0cyclictest0-21swapper/307:33:063
12398992220,1cyclictest24185-21apt-get08:40:013
12398992220,1cyclictest18897-21ssh12:11:453
1239899220,22cyclictest0-21swapper/310:10:543
1239899220,22cyclictest0-21swapper/309:35:543
1239899220,21cyclictest32276-21apt-get08:58:073
1239899220,21cyclictest31360-21ssh11:25:043
1239899220,21cyclictest22345-21ssh10:20:513
1239899220,21cyclictest21517-21ssh11:17:153
1239899220,21cyclictest1026-21ssh10:02:523
1239899220,21cyclictest0-21swapper/311:33:103
1239899220,1cyclictest8869-21sh11:05:283
1239899220,1cyclictest27256-21rm07:40:013
1239899220,1cyclictest0-21swapper/308:48:063
1239899220,0cyclictest0-21swapper/310:56:003
12397992222,0cyclictest0-21swapper/210:15:282
12397992221,1cyclictest0-21swapper/212:25:302
12397992220,1cyclictest0-21swapper/212:11:552
1239799220,22cyclictest0-21swapper/211:36:032
1239799220,21cyclictest6551-21diskmemload12:36:022
1239799220,21cyclictest6551-21diskmemload11:05:252
1239799220,21cyclictest6551-21diskmemload09:20:132
1239799220,21cyclictest26482-21sh11:21:132
1239799220,21cyclictest132282sleep207:13:062
1239799220,21cyclictest0-21swapper/211:45:282
1239799220,1cyclictest0-21swapper/211:59:422
1239799220,0cyclictest0-21swapper/210:45:302
1239799220,0cyclictest0-21swapper/209:16:262
12395992221,1cyclictest0-21swapper/112:22:161
12395992221,1cyclictest0-21swapper/112:22:161
12395992221,0cyclictest0-21swapper/108:28:061
12395992220,1cyclictest25312-21apt-get07:38:051
12395992220,1cyclictest18130-21apt-get07:23:061
1239599220,21cyclictest5031-21apt-get08:03:091
1239599220,21cyclictest25086-21apt-get08:43:061
1239599220,21cyclictest0-21swapper/108:13:061
1239599220,1cyclictest22-21ksoftirqd/112:08:131
12394992222,0cyclictest6551-21diskmemload12:25:160
12394992222,0cyclictest6551-21diskmemload12:07:260
12394992221,1cyclictest6551-21diskmemload11:05:400
12394992221,1cyclictest24185-21apt-get08:40:020
1239499220,2cyclictest10753-21sh09:42:540
1239499220,22cyclictest4319-21ssh11:30:000
1239499220,21cyclictest6551-21diskmemload11:35:140
1239499220,21cyclictest4673-21apt-get09:08:070
1239499220,21cyclictest4179-21perf09:05:000
1239499220,21cyclictest32080-21ssh10:00:590
1239499220,1cyclictest4650-21sh11:30:060
1239499220,1cyclictest25987-21ssh11:20:320
1239499220,1cyclictest1771-21apt09:00:000
1239499220,1cyclictest0-21swapper/012:10:200
12398992121,0cyclictest0-21swapper/312:00:083
1239899210,21cyclictest0-21swapper/310:50:033
1239899210,20cyclictest0-21swapper/307:23:063
12397992120,1cyclictest0-21swapper/208:40:022
12397992119,1cyclictest31765-21cron08:55:002
1239799210,21cyclictest0-21swapper/210:05:032
1239799210,20cyclictest9818-21apt-get08:13:062
1239799210,20cyclictest0-21swapper/207:58:062
1239799210,1cyclictest19883-21apt-get08:33:082
1239799210,0cyclictest0-21swapper/208:38:062
12395992120,1cyclictest0-21swapper/108:20:021
12395992119,1cyclictest17605-21awk07:20:001
1239599210,21cyclictest0-21swapper/109:08:071
12394992121,0cyclictest0-21swapper/008:53:040
12394992121,0cyclictest0-21swapper/007:43:070
12394992119,1cyclictest0-21swapper/007:50:010
1239499210,21cyclictest6551-21diskmemload12:35:020
1239499210,21cyclictest6551-21diskmemload10:56:120
1239499210,20cyclictest0-21swapper/007:38:050
12398992020,0cyclictest0-21swapper/307:58:063
12398992019,1cyclictest0-21swapper/308:18:043
12398992018,1cyclictest14112-21apt-get08:20:023
1239899200,0cyclictest0-21swapper/307:10:023
12397992020,0cyclictest0-21swapper/207:38:052
12397992020,0cyclictest0-21swapper/207:23:062
12397992019,1cyclictest12212-21apt-get08:18:042
1239799200,0cyclictest0-21swapper/207:33:062
12395992020,0cyclictest22274-21apt-get08:38:061
12395992020,0cyclictest0-21swapper/107:53:051
1239599200,3cyclictest0-21swapper/108:08:081
1239599200,20cyclictest0-21swapper/109:04:511
12394992020,0cyclictest0-21swapper/008:23:060
12394992020,0cyclictest0-21swapper/008:08:080
12394992020,0cyclictest0-21swapper/008:03:090
12394992018,1cyclictest0-21swapper/008:40:010
1239499200,20cyclictest0-21swapper/007:28:070
1239499200,0cyclictest0-21swapper/008:28:060
12398991919,0cyclictest0-21swapper/308:08:083
12398991919,0cyclictest0-21swapper/307:53:063
1239799190,19cyclictest0-21swapper/207:30:002
12395991919,0cyclictest0-21swapper/108:18:041
12395991917,1cyclictest622-21gdbus08:50:001
1239599190,0cyclictest0-21swapper/108:33:081
12394991919,0cyclictest0-21swapper/007:10:020
12398991818,0cyclictest29880-21apt-get08:53:043
12398991818,0cyclictest0-21swapper/309:08:073
12398991818,0cyclictest0-21swapper/307:48:063
12398991817,0cyclictest0-21swapper/308:28:063
12397991818,0cyclictest0-21swapper/208:48:072
12395991818,0cyclictest0-21swapper/108:53:051
12395991818,0cyclictest0-21swapper/107:10:021
12394991818,0cyclictest0-21swapper/008:48:060
1239899170,9cyclictest4165-21basename09:05:003
12397991716,1cyclictest30232-21apt-get07:48:052
1239599170,3cyclictest0-21swapper/107:28:071
12397991616,0cyclictest17480-21apt-get08:28:062
12397991615,0cyclictest32627-21apt-get07:53:062
1239799160,2cyclictest6723-21grep08:03:192
12394991616,0cyclictest0-21swapper/007:53:050
1239899159,5cyclictest6803-21munin-node08:04:003
12398991515,0cyclictest20524-21apt-get07:28:073
12398991515,0cyclictest0-21swapper/308:43:063
1239899150,0cyclictest0-21swapper/308:33:083
12397991515,0cyclictest0-21swapper/209:08:072
1239499151,14cyclictest1710-21apache208:30:480
12398991414,0cyclictest0-21swapper/308:10:113
1239899140,14cyclictest0-21swapper/307:40:483
1239899140,14cyclictest0-21swapper/307:15:193
1239799140,14cyclictest0-21swapper/208:05:242
1239799140,14cyclictest0-21swapper/207:17:102
1239799140,0cyclictest0-21swapper/209:02:042
1239799140,0cyclictest0-21swapper/207:40:142
1239599140,0cyclictest0-21swapper/107:55:561
12394991414,0cyclictest0-21swapper/008:10:060
12394991414,0cyclictest0-21swapper/007:55:370
12394991414,0cyclictest0-21swapper/007:16:240
1239499140,0cyclictest0-21swapper/008:15:140
1239499140,0cyclictest0-21swapper/007:20:320
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional