You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 01:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Wed Dec 10, 2025 00:39:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
885046995751,3cyclictest0-21swapper/121:19:291
885046995343,7cyclictest912008-21cron20:40:001
885046995343,7cyclictest912008-21cron20:40:001
88504699533,39cyclictest1006440-21ssh22:59:241
885045995124,24cyclictest0-21swapper/000:19:300
885046995041,5cyclictest1011297-21cron23:05:011
885045995026,21cyclictest421-21avahi-daemon23:10:300
885045994939,5cyclictest0-21swapper/019:40:010
885045994831,14cyclictest0-21swapper/021:05:010
885045994811,14cyclictest1083770-21ssh00:39:220
885045994728,13cyclictest0-21swapper/020:40:010
885045994728,13cyclictest0-21swapper/020:40:010
885045994724,19cyclictest0-21swapper/023:10:010
885045994724,19cyclictest0-21swapper/021:34:320
885045994724,19cyclictest0-21swapper/021:34:320
885045994720,24cyclictest993383-21sshd22:43:390
885045994720,24cyclictest0-21swapper/021:40:010
885047994537,5cyclictest929150-21sendmail21:20:012
885046994537,5cyclictest0-21swapper/122:05:011
885045994534,5cyclictest151ktimers/020:29:280
885045994530,12cyclictest422-21dbus-daemon00:30:010
885047994438,3cyclictest0-21swapper/222:45:012
885046994435,6cyclictest421-21avahi-daemon21:30:011
885046994435,3cyclictest0-21swapper/123:29:221
885046994434,7cyclictest422-21dbus-daemon23:40:011
885046994434,7cyclictest422-21dbus-daemon23:40:011
885046994433,5cyclictest0-21swapper/123:14:261
885045994436,5cyclictest1-21systemd19:10:020
885045994435,6cyclictest151ktimers/000:04:300
885047994337,3cyclictest0-21swapper/221:40:012
885047994334,6cyclictest1055298-21cups-browsed00:39:402
88504599433,7cyclictest902454-21ntpq20:09:240
88504599432,6cyclictest896416-21ntpq19:49:210
885045994318,22cyclictest924841-21grep21:14:350
88504599431,11cyclictest885680-21/usr/sbin/munin19:14:160
885047994235,3cyclictest0-21swapper/221:00:012
885047994234,5cyclictest422-21dbus-daemon21:25:022
885047994232,4cyclictest0-21swapper/222:24:282
885046994237,2cyclictest0-21swapper/119:40:011
885046994232,4cyclictest0-21swapper/122:49:211
88504599429,2cyclictest0-21swapper/019:19:230
885045994234,4cyclictest0-21swapper/023:49:260
885045994230,9cyclictest1073841-21cron00:25:010
88504599422,15cyclictest1055152-21sendmail00:00:010
885045994218,21cyclictest0-21swapper/021:45:010
885045994211,2cyclictest0-21swapper/020:34:240
885045994211,2cyclictest0-21swapper/020:34:240
885045994211,26cyclictest978870-21ssh22:24:240
885047994135,3cyclictest0-21swapper/200:00:012
88504799412,29cyclictest998512-21ssh22:49:252
885046994133,5cyclictest1066368-21latency_hist00:15:021
885046994133,3cyclictest0-21swapper/100:04:241
885046994129,9cyclictest940818-21/usr/sbin/munin21:35:011
885046994129,9cyclictest940818-21/usr/sbin/munin21:35:011
88504599416,29cyclictest951661-21ssh21:49:240
88504599414,11cyclictest437-21mta-sts-daemon00:14:240
88504599413,9cyclictest1026093-21ssh23:24:250
88504599413,10cyclictest891969-21ntpq19:34:230
88504599412,7cyclictest905429-21ntpq20:19:260
88504599412,7cyclictest1002418-21ntpq22:54:220
88504599412,6cyclictest890451-21ntpq19:29:220
885045994124,13cyclictest0-21swapper/022:19:250
885045994124,13cyclictest0-21swapper/022:19:250
88504599412,13cyclictest982816-21ntpq22:29:240
88504599411,7cyclictest920394-21ntpq21:09:200
88504599411,15cyclictest1080261-21ntpq00:34:240
88504599411,11cyclictest897970-21ntpq19:54:250
88504599411,11cyclictest3227706-21cupsd21:21:410
88504599411,10cyclictest1035813-21ssh23:36:060
88504599411,10cyclictest1035813-21ssh23:36:060
885045994110,2cyclictest0-21swapper/020:14:360
885047994032,5cyclictest1081064-21grep00:35:012
885047994031,5cyclictest0-21swapper/221:14:222
885046994032,5cyclictest0-21swapper/100:00:021
885046994025,3cyclictest171rcu_preempt20:19:161
88504599403,8cyclictest928207-21ntpq21:19:240
885045994035,2cyclictest0-21swapper/023:54:260
88504599402,15cyclictest1042128-21ssh23:44:210
88504599402,15cyclictest1042128-21ssh23:44:210
88504599402,12cyclictest986822-21ssh22:34:270
88504599401,9cyclictest955523-21ntpq21:54:230
88504599401,9cyclictest901466-21unixbench_singl20:04:360
885045994017,20cyclictest987877-21kworker/u8:0-xprtiod22:39:260
88504599401,5cyclictest1034160-21ntpq23:34:250
885045994011,2cyclictest0-21swapper/019:23:340
88504599401,10cyclictest1028284-21ssh23:27:090
88504599400,8cyclictest1019839-21ssh23:16:040
885047993931,5cyclictest422-21dbus-daemon23:35:022
885046993931,5cyclictest0-21swapper/120:49:261
885046993930,5cyclictest955-21mta-sts-daemon00:30:171
88504699391,28cyclictest924205-21ssh21:14:231
88504599391,9cyclictest1060999-21ssh00:08:470
88504599391,9cyclictest1010233-21memory23:04:180
88504599391,8cyclictest969279-21ssh22:12:010
885045993918,17cyclictest12450irq/32-eth021:29:230
885045993911,2cyclictest0-21swapper/020:24:240
88504599391,11cyclictest961174-21ssh22:01:210
88504599391,11cyclictest895034-21ntpq19:44:250
88504599391,11cyclictest895034-21ntpq19:44:250
88504599391,10cyclictest917449-21ntpq20:59:260
88504599390,5cyclictest957848-21ssh21:57:340
885047993829,6cyclictest1051145-21cron23:55:012
885046993832,3cyclictest0-21swapper/122:14:111
885046993829,6cyclictest1061614-21if_eth000:09:211
885046993829,4cyclictest0-21swapper/121:54:271
885046993825,6cyclictest0-21swapper/123:09:231
88504699382,27cyclictest951713-21ssh21:49:261
88504699381,27cyclictest1069299-21ssh00:19:291
88504599383,7cyclictest1006615-21ntpq22:59:300
88504599381,9cyclictest997459-21ssh22:48:440
88504599381,16cyclictest899888-21unixbench-2d19:59:320
88504599381,14cyclictest912979-21ntpq20:44:250
88504799373,26cyclictest939922-21ssh21:34:232
88504799373,26cyclictest939922-21ssh21:34:232
885047993729,5cyclictest910523-21munin-run20:35:012
885047993729,5cyclictest910523-21munin-run20:35:012
885047993729,5cyclictest1023014-21grep23:20:012
885047993728,4cyclictest0-21swapper/221:29:242
885047993727,5cyclictest0-21swapper/222:19:262
885047993727,5cyclictest0-21swapper/222:19:262
885046993729,5cyclictest955-21mta-sts-daemon19:24:261
885046993728,6cyclictest1084825-21latency_hist00:40:031
885046993727,6cyclictest956-21mta-sts-daemon22:24:301
885046993710,6cyclictest28-21ksoftirqd/123:42:071
885046993710,6cyclictest28-21ksoftirqd/123:42:071
88504599371,12cyclictest915911-21ntpq20:54:240
88504599370,6cyclictest966581-21ssh22:09:130
885047993629,3cyclictest0-21swapper/222:39:292
885047993628,5cyclictest967850-21sh22:09:362
885047993628,5cyclictest956398-21idleruntime-cro21:55:012
88504799362,27cyclictest1026178-21ssh23:24:282
885046993630,3cyclictest0-21swapper/122:55:011
885046993628,5cyclictest1027010-21latency_hist23:25:021
885046993627,5cyclictest902978-21unixbench_singl20:09:341
885046993627,4cyclictest0-21swapper/121:24:211
885046993626,7cyclictest0-21swapper/123:35:021
885046993626,4cyclictest0-21swapper/123:19:241
885046993611,9cyclictest28-21ksoftirqd/121:04:261
88504599363,6cyclictest914529-21ntpq20:49:280
885047993527,5cyclictest421-21avahi-daemon23:46:402
885047993527,5cyclictest1070028-21munin-run00:20:012
885047993527,3cyclictest0-21swapper/221:59:392
885047993526,6cyclictest421-21avahi-daemon19:34:292
885047993526,4cyclictest0-21swapper/200:29:232
885047993524,8cyclictest982669-21missed_timers22:29:202
885047993524,8cyclictest0-21swapper/223:09:122
885046993529,3cyclictest0-21swapper/122:40:471
885046993528,4cyclictest0-21swapper/122:29:271
885046993524,6cyclictest0-21swapper/123:49:261
885046993514,4cyclictest28-21ksoftirqd/119:49:261
885046993512,5cyclictest28-21ksoftirqd/122:39:271
885046993510,4cyclictest28-21ksoftirqd/122:09:251
88504799345,18cyclictest437-21mta-sts-daemon19:19:252
88504799343,24cyclictest947697-21ssh21:44:202
885047993425,4cyclictest955-21mta-sts-daemon20:29:242
885047993423,8cyclictest1065426-21needreboot00:14:212
885046993427,3cyclictest0-21swapper/119:44:191
885046993427,3cyclictest0-21swapper/119:44:191
885046993426,5cyclictest892552-21systemd-run19:35:011
885046993425,5cyclictest143398-21kworker/u8:6-rpciod20:05:011
88504699342,24cyclictest1050393-21ssh23:54:291
885046993413,5cyclictest28-21ksoftirqd/120:59:231
885046993412,5cyclictest28-21ksoftirqd/121:55:471
885046993412,5cyclictest28-21ksoftirqd/121:39:151
885047993327,3cyclictest0-21swapper/219:15:022
885047993325,4cyclictest0-21swapper/223:37:402
885047993325,4cyclictest0-21swapper/223:37:402
885047993324,5cyclictest0-21swapper/223:14:272
885047993323,6cyclictest1073019-21ssh00:24:262
88504799332,24cyclictest1002410-21ssh22:54:222
885046993325,5cyclictest453-21systemd-logind20:45:011
885046993312,5cyclictest28-21ksoftirqd/100:24:281
885046993310,4cyclictest28-21ksoftirqd/122:34:261
885046993310,13cyclictest28-21ksoftirqd/100:28:141
885047993225,4cyclictest956-21mta-sts-daemon00:08:162
885047993224,5cyclictest906575-21fschecks_count20:24:162
885047993223,6cyclictest1007063-21grep22:59:372
88504799321,25cyclictest1042178-21ssh23:44:232
88504799321,25cyclictest1042178-21ssh23:44:232
88504699329,5cyclictest28-21ksoftirqd/122:18:191
88504699329,5cyclictest28-21ksoftirqd/122:18:191
885046993225,4cyclictest898536-21kworker/u8:1+xprtiod19:55:021
885046993213,5cyclictest28-21ksoftirqd/121:44:261
885047993125,4cyclictest885044-21cyclictest19:54:342
885047993125,3cyclictest0-21swapper/200:04:362
885047993124,4cyclictest0-21swapper/220:00:012
885047993124,3cyclictest0-21swapper/220:10:022
885047993123,5cyclictest956-21mta-sts-daemon22:02:052
885047993120,8cyclictest970869-21latency22:14:182
885046993123,5cyclictest900020-21munin-plugin-st20:00:011
885046993110,4cyclictest28-21ksoftirqd/120:34:261
885046993110,4cyclictest28-21ksoftirqd/120:34:261
885046993110,11cyclictest28-21ksoftirqd/120:29:241
885047993024,3cyclictest0-21swapper/221:10:012
885047993023,4cyclictest919357-21timerwakeupswit21:04:362
885047993022,5cyclictest891058-21systemd-run19:30:012
885047993021,4cyclictest0-21swapper/219:24:262
885047993020,6cyclictest1030061-21/usr/sbin/munin23:29:232
885046993011,4cyclictest28-21ksoftirqd/120:54:281
885046993011,11cyclictest28-21ksoftirqd/119:14:261
885047992923,3cyclictest0-21swapper/220:20:012
885047992920,4cyclictest351ktimers/220:04:232
885046992922,4cyclictest920914-21tail21:09:351
88504799282,20cyclictest657-21snmpd21:46:012
885047992821,3cyclictest0-21swapper/222:34:202
885047992819,6cyclictest915554-21fschecks_count20:54:182
88504699288,4cyclictest28-21ksoftirqd/119:29:141
885046992819,6cyclictest421-21avahi-daemon20:24:241
885046992810,4cyclictest28-21ksoftirqd/119:19:241
88504799274,3cyclictest171rcu_preempt20:49:292
885047992722,2cyclictest0-21swapper/220:45:002
885047992720,3cyclictest0-21swapper/223:04:242
885047992620,3cyclictest0-21swapper/219:40:012
88504699267,3cyclictest28-21ksoftirqd/120:14:231
885047992519,3cyclictest0-21swapper/219:44:122
885047992519,3cyclictest0-21swapper/219:44:122
885047992517,5cyclictest491-21gdbus20:15:002
885047992517,5cyclictest1-21systemd19:47:402
885047992517,5cyclictest0-21swapper/220:40:012
885047992517,5cyclictest0-21swapper/220:40:012
885047992210,9cyclictest422-21dbus-daemon19:10:022
88504899202,8cyclictest0-21swapper/321:24:263
88504899192,9cyclictest0-21swapper/321:39:223
88504899183,9cyclictest0-21swapper/323:49:263
88504899182,8cyclictest0-21swapper/323:24:273
88504699183,4cyclictest28-21ksoftirqd/119:10:021
88504899173,7cyclictest0-21swapper/323:14:283
88504899172,6cyclictest0-21swapper/300:34:223
88504899171,9cyclictest0-21swapper/322:54:213
88504899162,9cyclictest0-21swapper/322:32:393
88504899162,7cyclictest0-21swapper/323:34:233
88504899162,7cyclictest0-21swapper/321:29:243
88504899162,7cyclictest0-21swapper/321:19:243
88504899162,6cyclictest0-21swapper/323:04:223
88504899161,8cyclictest0-21swapper/321:54:233
88504899161,8cyclictest0-21swapper/300:14:183
88504899161,8cyclictest0-21swapper/300:09:263
88504899161,7cyclictest0-21swapper/320:39:233
88504899161,7cyclictest0-21swapper/320:39:233
88504899161,6cyclictest0-21swapper/320:24:273
88504899153,7cyclictest0-21swapper/300:39:293
88504899153,7cyclictest0-21swapper/300:29:263
88504899153,6cyclictest0-21swapper/319:19:263
88504899152,8cyclictest0-21swapper/323:44:203
88504899152,8cyclictest0-21swapper/323:44:203
88504899152,8cyclictest0-21swapper/322:29:253
88504899152,8cyclictest0-21swapper/300:00:013
88504899152,6cyclictest0-21swapper/321:09:253
88504899151,8cyclictest0-21swapper/322:09:303
88504899151,8cyclictest0-21swapper/321:44:203
88504899151,8cyclictest0-21swapper/300:04:273
88504899151,7cyclictest0-21swapper/321:49:223
88504899151,6cyclictest0-21swapper/319:29:203
88504899151,6cyclictest0-21swapper/319:14:213
88504899143,7cyclictest0-21swapper/322:19:283
88504899143,7cyclictest0-21swapper/322:19:283
88504899142,7cyclictest0-21swapper/321:05:013
88504899142,7cyclictest0-21swapper/320:29:393
88504899142,5cyclictest0-21swapper/319:34:203
88504899141,8cyclictest0-21swapper/322:24:303
88504899141,7cyclictest0-21swapper/323:29:123
88504899141,7cyclictest0-21swapper/322:14:253
88504899141,7cyclictest0-21swapper/321:59:273
88504899141,7cyclictest0-21swapper/300:19:233
88504899132,8cyclictest0-21swapper/323:51:393
88504899132,7cyclictest0-21swapper/323:19:163
88504899132,7cyclictest0-21swapper/321:14:253
88504899132,6cyclictest0-21swapper/323:39:223
88504899132,6cyclictest0-21swapper/323:39:223
88504899132,5cyclictest0-21swapper/323:09:163
88504899131,8cyclictest0-21swapper/322:44:153
88504899131,7cyclictest0-21swapper/322:39:213
88504899131,7cyclictest0-21swapper/322:04:223
88504899131,6cyclictest0-21swapper/320:44:283
88504899131,6cyclictest0-21swapper/320:34:213
88504899131,6cyclictest0-21swapper/320:34:213
88504899131,6cyclictest0-21swapper/320:19:283
88504899131,6cyclictest0-21swapper/320:14:263
88504899131,6cyclictest0-21swapper/319:54:253
88504899121,7cyclictest0-21swapper/322:49:123
88504899121,7cyclictest0-21swapper/300:24:263
88504899121,6cyclictest0-21swapper/320:54:263
88504899121,6cyclictest0-21swapper/319:49:223
88504899120,7cyclictest0-21swapper/319:59:233
88504899113,5cyclictest0-21swapper/320:59:313
88504899112,6cyclictest0-21swapper/322:59:133
88504899112,6cyclictest0-21swapper/320:49:213
88504899111,5cyclictest0-21swapper/319:39:203
88504899110,7cyclictest0-21swapper/321:34:133
88504899110,7cyclictest0-21swapper/321:34:133
88504899101,5cyclictest0-21swapper/320:09:223
88504899101,5cyclictest0-21swapper/320:04:143
88504899101,5cyclictest0-21swapper/319:40:403
88504899101,5cyclictest0-21swapper/319:40:403
88504899101,4cyclictest0-21swapper/319:10:033
8850489990,6cyclictest0-21swapper/319:24:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional