You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-23 - 19:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat May 23, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
941143994940,6cyclictest204-21dbus-daemon07:45:192
941147994639,4cyclictest972601-21sendmail08:40:013
941147994620,21cyclictest0-21swapper/309:00:253
941139994632,11cyclictest231ktimers/110:10:131
941147994536,5cyclictest1055915-21idleruntime-cro12:40:003
941147994536,5cyclictest1055915-21idleruntime-cro12:40:003
94114799441,9cyclictest993499-21apt-get09:40:133
94114799441,40cyclictest995300-21seq09:45:143
94114799440,10cyclictest1049339-21apt-get12:20:113
94114799431,9cyclictest945852-21/usr/sbin/munin07:20:223
94114799431,9cyclictest1041243-21/usr/sbin/munin11:55:193
941147994313,27cyclictest1002019-21/usr/sbin/munin10:05:233
941139994335,5cyclictest969182-21munin-plugin-st08:30:001
941135994333,5cyclictest0-21swapper/012:15:000
94114799428,8cyclictest1021711-21sed11:00:193
94114799421,9cyclictest1036564-21users11:40:253
941147994216,23cyclictest391ktimers/307:35:133
941147994216,23cyclictest0-21swapper/310:30:213
941147994212,26cyclictest0-21swapper/308:05:173
941143994230,9cyclictest311ktimers/210:15:142
94114799411,9cyclictest943702-21/usr/sbin/munin07:15:143
941147994115,22cyclictest0-21swapper/310:45:213
941139994133,4cyclictest0-21swapper/110:00:001
941139994131,7cyclictest972577-21sh08:40:011
941135994132,5cyclictest0-21swapper/009:00:250
94114799401,9cyclictest1019067-21idleruntime-cro10:55:003
941147994015,21cyclictest0-21swapper/311:15:203
941147994011,3cyclictest986492-21latency_hist09:20:003
941139994026,9cyclictest0-21swapper/111:21:181
941147993931,4cyclictest0-21swapper/310:16:033
94114799392,9cyclictest1051224-21cut12:25:153
94114799391,9cyclictest981725-21grep09:05:153
94114799391,9cyclictest1044488-21/usr/sbin/munin12:05:163
94114799391,8cyclictest988381-21/usr/sbin/munin09:25:223
94114799391,8cyclictest438-21cron09:25:003
94114799391,11cyclictest1010318-21munin-run10:29:593
94114799391,10cyclictest942334-21head07:10:253
941147993910,6cyclictest1032661-21wc11:30:243
941143993931,4cyclictest0-21swapper/212:25:002
941135993932,5cyclictest972241-21kworker/u8:0+events_unbound10:06:040
941135993931,5cyclictest955300-21cron07:50:000
94114799384,6cyclictest1038795-21seq11:49:103
94114799384,4cyclictest0-21swapper/307:52:143
94114799384,4cyclictest0-21swapper/307:52:143
94114799382,8cyclictest947012-21sshd07:25:073
94114799381,9cyclictest968059-21/usr/sbin/munin08:25:193
94114799381,9cyclictest1046029-21df_inode12:10:123
94114799381,8cyclictest984714-21cron09:15:003
94114799381,8cyclictest984714-21cron09:15:003
94114799381,8cyclictest1030604-21/usr/sbin/munin11:25:193
941147993817,18cyclictest0-21swapper/311:50:163
941147993813,22cyclictest0-21swapper/308:21:343
94114799381,11cyclictest1023577-21memory11:05:203
94114799381,10cyclictest979045-21/usr/sbin/munin08:55:273
94114799381,10cyclictest957696-21memory07:55:213
94114799381,10cyclictest1042628-21df_inode12:00:143
94114799381,10cyclictest1020066-21ntp_states10:55:223
94114799381,10cyclictest1015013-21grep10:40:263
94114799371,9cyclictest998651-21/usr/sbin/munin09:55:153
94114799371,9cyclictest992857-21users09:35:273
94114799371,9cyclictest962815-21meminfo08:10:213
94114799371,9cyclictest1034781-21tail11:35:253
94114799371,8cyclictest1029934-21munin-run11:25:003
94114799371,8cyclictest1004658-21/usr/sbin/munin10:10:263
94114799371,7cyclictest976194-21cron08:50:003
94114799371,6cyclictest959154-21fschecks_time08:00:173
94114799371,10cyclictest973371-21/usr/sbin/munin08:40:173
94114799371,10cyclictest969851-21meminfo08:30:193
94114799371,10cyclictest964732-21/usr/sbin/munin08:15:203
94114799371,10cyclictest964732-21/usr/sbin/munin08:15:203
94114799365,5cyclictest0-21swapper/311:10:313
94114799361,9cyclictest952707-21/usr/sbin/munin07:40:223
94114799361,9cyclictest1052975-21/usr/sbin/munin12:30:173
94114799361,9cyclictest1048158-21/usr/sbin/munin12:15:203
94114799361,6cyclictest997921-21tail09:50:263
94114799361,10cyclictest949176-21/usr/sbin/munin07:30:193
941135993627,6cyclictest121ktimers/008:25:140
941135993624,7cyclictest997945-21grep09:50:260
941135993623,8cyclictest1033314-21cron11:35:000
94114799352,4cyclictest0-21swapper/307:45:173
94114799351,8cyclictest990077-21/usr/sbin/munin09:30:233
94114799351,6cyclictest1008619-21munin-plugin-st10:25:003
94114799351,6cyclictest1008619-21munin-plugin-st10:25:003
94114799351,11cyclictest1012798-21ntpq10:35:243
94114799351,10cyclictest976490-21/usr/sbin/munin08:50:143
941139993525,5cyclictest0-21swapper/107:50:171
941139993525,5cyclictest0-21swapper/107:50:171
941135993527,4cyclictest0-21swapper/008:20:470
941135993523,9cyclictest121ktimers/008:05:130
941135993523,7cyclictest983471-21grep09:10:170
941135993523,7cyclictest983471-21grep09:10:170
94114799341,9cyclictest1001764-21taskset10:04:513
941143993427,4cyclictest0-21swapper/208:10:002
941143993424,6cyclictest983445-21cut09:10:172
941143993424,6cyclictest983445-21cut09:10:172
941139993427,4cyclictest0-21swapper/110:50:001
941139993426,5cyclictest1042267-21audit_send_reply12:00:001
941139993426,4cyclictest0-21swapper/109:30:171
941139993426,4cyclictest0-21swapper/108:45:161
94113599346,5cyclictest131rcu_preempt07:25:130
941135993427,5cyclictest151rcuc/011:01:150
941135993424,5cyclictest972568-21cron08:40:010
941143993325,4cyclictest0-21swapper/211:50:012
94113599333,5cyclictest131rcu_preempt10:40:120
941135993326,4cyclictest0-21swapper/009:50:010
941135993324,6cyclictest1024594-21idleruntime-cro11:10:010
941135993323,6cyclictest0-21swapper/012:30:000
941135993323,5cyclictest955754-21grep07:50:170
941135993323,5cyclictest955754-21grep07:50:170
941135993322,7cyclictest0-21swapper/007:40:000
941135993320,10cyclictest204-21dbus-daemon07:40:140
941143993225,4cyclictest0-21swapper/211:00:152
941143993220,8cyclictest967020-21grep08:20:242
941139993224,4cyclictest0-21swapper/112:31:271
941139993224,4cyclictest0-21swapper/110:30:171
941139993222,7cyclictest0-21swapper/110:10:001
941139993222,6cyclictest0-21swapper/108:50:251
94113599323,5cyclictest131rcu_preempt11:35:120
94113599323,5cyclictest131rcu_preempt10:25:130
941135993226,4cyclictest1011960-21kworker/u8:0+events_unbound10:51:100
941143993123,4cyclictest0-21swapper/209:45:012
941143993122,6cyclictest0-21swapper/209:15:252
941143993122,6cyclictest0-21swapper/207:15:012
941143993121,7cyclictest958736-21idleruntime-cro08:00:002
941139993123,4cyclictest0-21swapper/110:20:001
941139993123,4cyclictest0-21swapper/107:35:361
941139993122,6cyclictest0-21swapper/109:10:171
941139993122,6cyclictest0-21swapper/109:10:171
941139993122,5cyclictest0-21swapper/109:45:261
94113599314,4cyclictest131rcu_preempt09:30:120
941135993123,6cyclictest1016981-21kworker/u8:3+events_unbound10:56:140
941135993123,5cyclictest986018-21unixbench_singl09:15:250
941143993023,4cyclictest0-21swapper/211:55:252
941143993023,3cyclictest0-21swapper/209:50:262
941143993022,4cyclictest0-21swapper/208:20:002
941143993022,4cyclictest0-21swapper/208:20:002
941139993024,4cyclictest989912-21latency_hist09:30:011
941139993023,4cyclictest0-21swapper/111:10:011
941139993023,4cyclictest0-21swapper/109:05:241
941139993023,3cyclictest0-21swapper/110:50:241
94113599309,5cyclictest131rcu_preempt08:40:120
941135993023,4cyclictest1037587-21fschecks_time11:45:160
941135993022,5cyclictest0-21swapper/009:00:000
941135993021,6cyclictest0-21swapper/012:15:160
941135993020,6cyclictest1041785-21grep11:55:250
941143992922,5cyclictest972241-21kworker/u8:0+events_unbound08:55:542
941143992922,4cyclictest941129-21cyclictest11:20:162
941143992921,4cyclictest0-21swapper/212:35:252
941143992921,4cyclictest0-21swapper/212:35:252
941139992922,3cyclictest0-21swapper/108:15:261
941139992922,3cyclictest0-21swapper/108:15:261
941139992921,4cyclictest993246-21auditctl09:40:011
941139992910,3cyclictest131rcu_preempt08:15:021
941135992920,4cyclictest0-21swapper/010:20:000
941135992919,6cyclictest0-21swapper/008:15:260
941135992919,6cyclictest0-21swapper/008:15:260
94113599291,6cyclictest131rcu_preempt12:20:120
941143992823,3cyclictest951964-21latency_hist07:40:012
941143992823,3cyclictest1019233-21latency_hist10:55:012
941143992821,3cyclictest0-21swapper/211:35:152
941143992818,5cyclictest0-21swapper/210:30:002
941139992820,4cyclictest0-21swapper/110:20:271
941139992820,4cyclictest0-21swapper/110:20:271
941139992820,3cyclictest0-21swapper/112:20:001
941135992821,3cyclictest0-21swapper/011:50:250
941135992821,3cyclictest0-21swapper/011:45:000
94113599281,5cyclictest131rcu_preempt09:35:140
941143992721,3cyclictest0-21swapper/211:10:012
941143992721,3cyclictest0-21swapper/210:45:022
941139992719,4cyclictest0-21swapper/111:15:251
941139992718,6cyclictest974498-21sh08:45:011
941139992717,6cyclictest0-21swapper/112:25:001
941135992719,4cyclictest958720-21munin-plugin-st08:00:000
941135992719,4cyclictest0-21swapper/012:05:250
941135992719,4cyclictest0-21swapper/010:20:180
941135992719,4cyclictest0-21swapper/010:20:180
941135992718,5cyclictest0-21swapper/010:35:000
941135992717,4cyclictest0-21swapper/008:10:280
941143992620,3cyclictest0-21swapper/207:45:002
941143992619,4cyclictest0-21swapper/212:00:152
941143992618,5cyclictest53-21kcompactd008:50:152
941143992617,7cyclictest1033336-21cut11:35:002
941139992619,3cyclictest0-21swapper/111:00:151
941139992619,3cyclictest0-21swapper/107:30:251
941139992618,5cyclictest1056103-21latency_hist12:40:001
941139992618,5cyclictest1056103-21latency_hist12:40:001
941139992618,4cyclictest0-21swapper/111:55:011
941139992615,8cyclictest966573-21ntp_states08:20:211
94113999260,23cyclictest958147-21sed07:55:261
941135992622,2cyclictest13550irq/42-30be0000.ethernet07:10:150
941135992620,3cyclictest0-21swapper/010:46:090
941135992619,5cyclictest999154-21kworker/u8:1+events_unbound10:00:160
941135992619,3cyclictest0-21swapper/008:30:250
941135992618,5cyclictest1036575-21kworker/u8:1+events_unbound12:35:150
941135992618,5cyclictest1036575-21kworker/u8:1+events_unbound12:35:150
941135992617,5cyclictest1036575-21kworker/u8:1+events_unbound12:31:270
94114399252,4cyclictest131rcu_preempt12:15:112
941143992519,3cyclictest0-21swapper/211:15:242
941143992519,3cyclictest0-21swapper/209:20:252
941143992518,3cyclictest0-21swapper/208:35:272
941143992517,4cyclictest0-21swapper/207:20:012
941143992515,7cyclictest945912-21awk07:20:242
941143992510,12cyclictest311ktimers/209:05:242
941139992519,4cyclictest231ktimers/111:30:121
941139992517,4cyclictest0-21swapper/112:05:201
941139992515,6cyclictest1009865-21grep10:25:261
941139992510,3cyclictest131rcu_preempt07:40:241
94113599259,13cyclictest121ktimers/010:11:000
941135992516,4cyclictest0-21swapper/009:25:000
941135992515,6cyclictest1027739-21grep11:15:250
94113599251,21cyclictest959264-21if_eth008:00:180
94113599251,20cyclictest0-21swapper/007:34:050
94113599251,10cyclictest946802-21awk07:25:010
941143992418,3cyclictest0-21swapper/207:30:232
941143992417,4cyclictest0-21swapper/210:30:272
941143992416,5cyclictest0-21swapper/208:15:012
941143992414,7cyclictest969054-21seq08:28:392
941143992414,7cyclictest1036249-21swap11:40:232
941143992414,7cyclictest0-21swapper/207:50:212
941143992414,7cyclictest0-21swapper/207:50:212
941143992410,11cyclictest960438-21munin-plugin-st08:05:002
941139992417,4cyclictest0-21swapper/108:05:271
941139992410,3cyclictest131rcu_preempt11:47:341
941139992410,3cyclictest131rcu_preempt10:43:221
94113599248,4cyclictest131rcu_preempt11:25:120
94113599243,6cyclictest1000074-21munin-run10:00:000
94113599243,18cyclictest0-21swapper/012:03:550
941135992417,5cyclictest13550irq/42-30be0000.ethernet09:25:200
941135992415,6cyclictest0-21swapper/010:40:000
94113599241,19cyclictest0-21swapper/009:09:020
941143992318,2cyclictest0-21swapper/207:25:232
941143992317,4cyclictest995201-21/usr/sbin/munin09:45:232
941143992317,3cyclictest1020043-21ntpq10:55:212
941143992316,5cyclictest1023121-21kworker/u8:1+events_unbound11:26:202
941143992316,4cyclictest1013285-21grep10:35:282
941143992315,5cyclictest0-21swapper/209:40:012
941143992314,6cyclictest999857-21seq09:57:302
941143992314,6cyclictest974304-21seq08:42:412
941143992313,7cyclictest1026116-21awk11:10:402
94113999238,3cyclictest131rcu_preempt12:04:091
941139992316,4cyclictest438-21cron11:45:001
941139992315,4cyclictest0-21swapper/108:55:271
941139992313,6cyclictest1046261-21uname12:10:161
941135992318,3cyclictest13550irq/42-30be0000.ethernet08:45:120
941135992317,3cyclictest13550irq/42-30be0000.ethernet09:40:140
941135992313,8cyclictest11-21ksoftirqd/011:10:120
941143992216,3cyclictest0-21swapper/210:45:172
941143992213,6cyclictest1001901-21date10:05:012
941139992215,4cyclictest0-21swapper/109:50:251
941139992214,5cyclictest0-21swapper/107:45:151
941139992213,6cyclictest946222-21cat07:20:261
941139992213,6cyclictest1020536-21unixbench_singl10:55:251
941139992211,7cyclictest0-21swapper/107:15:021
94113599220,18cyclictest0-21swapper/008:52:390
941143992115,3cyclictest0-21swapper/212:25:222
941143992114,5cyclictest311ktimers/208:30:152
941143992114,4cyclictest1046452-21ntpq12:10:182
941143992114,4cyclictest1007282-21fschecks_count10:20:172
941143992114,4cyclictest1007282-21fschecks_count10:20:172
941143992113,6cyclictest0-21swapper/209:30:152
941143992112,6cyclictest311ktimers/209:05:002
941143992112,6cyclictest1039377-21if_err_eth111:50:162
94113999215,6cyclictest131rcu_preempt09:40:301
941139992113,4cyclictest0-21swapper/111:35:161
941139992112,5cyclictest0-21swapper/111:15:011
94113999211,18cyclictest231ktimers/109:24:281
941143992015,3cyclictest1044215-21/usr/sbin/munin12:05:162
941143992015,2cyclictest0-21swapper/212:30:182
941143992012,5cyclictest311ktimers/209:25:262
941143992011,6cyclictest1003831-21df_inode10:10:152
94113999209,8cyclictest985069-21df09:15:141
941139992014,3cyclictest1000431-21df10:00:151
94113999199,7cyclictest979970-21diskstats09:00:151
94113999198,8cyclictest1031416-21seq11:27:331
941139991913,4cyclictest959130-21fschecks_count08:00:171
941139991712,3cyclictest645-21runrttasks08:30:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional