You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 14:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Wed Jun 24, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
997359996338,22cyclictest1111510-21latency_hist00:39:590
997363995036,10cyclictest231ktimers/123:45:141
997363995036,10cyclictest231ktimers/123:45:131
997359995026,20cyclictest0-21swapper/019:50:260
997359994921,24cyclictest13550irq/42-30be0000.ethernet20:35:160
997359994921,24cyclictest13550irq/42-30be0000.ethernet20:35:160
997372994841,5cyclictest1109496-21kworker/u8:2+events_unbound00:31:263
997363994840,5cyclictest1053319-21fschecks_time21:50:161
99735999471,7cyclictest1101176-21latency_hist00:10:000
997359994620,23cyclictest0-21swapper/022:00:010
997363994536,6cyclictest1058017-21sh22:05:001
997359994426,14cyclictest1061631-21sh22:15:000
997359994418,21cyclictest0-21swapper/000:00:010
99735999431,6cyclictest1010614-21irqstats19:45:170
997359994316,23cyclictest0-21swapper/019:30:250
997359994316,23cyclictest0-21swapper/019:30:240
99735999431,11cyclictest1044287-21cron21:24:000
997372994230,9cyclictest1020386-21apt-config20:15:013
99735999421,9cyclictest1054747-21wc21:55:010
99735999421,9cyclictest1030469-21cron20:42:010
997359994216,23cyclictest13550irq/42-30be0000.ethernet22:00:190
99735999421,12cyclictest1001300-21sh19:20:010
99735999412,4cyclictest1106376-21cat00:25:010
99735999411,9cyclictest1095208-21/usr/sbin/munin23:50:240
99735999411,9cyclictest1088051-21/usr/sbin/munin23:30:200
99735999411,9cyclictest1036920-21/usr/sbin/munin21:00:250
99735999411,9cyclictest1032993-21/usr/sbin/munin20:50:180
99735999411,8cyclictest1093294-21/usr/sbin/munin23:45:240
99735999411,8cyclictest1093294-21/usr/sbin/munin23:45:240
99735999411,8cyclictest1014517-21/usr/sbin/munin19:55:250
99735999411,10cyclictest1046313-21apt-get21:30:140
997372994033,5cyclictest1061390-21kworker/u8:1+events_unbound22:16:183
997372994033,4cyclictest1043906-21unixbench_multi21:20:253
997367994028,8cyclictest311ktimers/220:15:102
99735999401,9cyclictest1083305-21/usr/sbin/munin23:15:250
99735999401,7cyclictest1069024-21/usr/sbin/munin22:35:160
99735999401,6cyclictest1066989-21/usr/sbin/munin22:30:120
99735999401,6cyclictest1066989-21/usr/sbin/munin22:30:120
99735999401,6cyclictest1066097-21/usr/sbin/munin22:25:290
99735999401,6cyclictest1066097-21/usr/sbin/munin22:25:280
99735999401,11cyclictest1022992-21ntpq20:20:310
99735999393,3cyclictest1016878-21munin-run20:05:010
99735999392,5cyclictest1038228-21memory21:05:210
99735999392,11cyclictest1039644-21cut21:10:180
99735999391,9cyclictest13550irq/42-30be0000.ethernet21:15:130
99735999391,9cyclictest1079263-21/usr/sbin/munin23:05:180
99735999391,9cyclictest1077136-21wc23:00:010
99735999391,9cyclictest1051563-21/usr/sbin/munin21:45:160
99735999391,9cyclictest1001542-21apt-get19:20:130
99735999391,9cyclictest1001542-21apt-get19:20:130
99735999391,8cyclictest1062152-21/usr/sbin/munin22:15:200
99735999391,7cyclictest1108680-21/usr/sbin/munin00:30:190
99735999391,7cyclictest1072864-21/usr/sbin/munin22:45:250
99735999391,7cyclictest1045376-21/usr/sbin/munin21:25:260
99735999391,7cyclictest1031294-21/usr/sbin/munin20:45:180
99735999391,7cyclictest1022148-21sshd20:19:420
99735999391,7cyclictest1006867-21/usr/sbin/munin19:35:140
99735999391,6cyclictest1103572-21ntp_states00:15:210
99735999391,5cyclictest1075283-21grep22:55:000
99735999391,4cyclictest1004721-21munin-run19:30:010
99735999391,4cyclictest1004721-21munin-run19:30:000
99735999391,11cyclictest1048469-21memory21:35:250
997367993827,8cyclictest998982-21auditctl19:15:012
99735999384,31cyclictest1017100-21apt-get20:05:120
99735999382,7cyclictest1101465-21fschecks_count00:10:140
99735999382,7cyclictest1071412-21sed22:40:250
99735999382,13cyclictest1065051-21cron22:25:010
99735999381,8cyclictest1035503-21sshd20:56:110
99735999381,7cyclictest1025351-21cron20:27:000
99735999381,10cyclictest1090991-21/usr/sbin/munin23:40:140
997359993810,25cyclictest1010051-21latency_hist19:45:000
997372993726,8cyclictest1022208-21sendmail20:20:003
997367993727,7cyclictest438-21cron22:55:012
997367993727,7cyclictest1023900-21sh20:25:002
997367993727,6cyclictest0-21swapper/219:50:242
997363993730,5cyclictest1033595-21kworker/u8:1+events_unbound20:51:111
997363993728,5cyclictest0-21swapper/119:20:001
997363993727,7cyclictest1078221-21grep23:00:281
997363993727,7cyclictest1007880-21grep19:35:261
99735999372,8cyclictest1078272-21grep23:00:270
99735999371,9cyclictest1097904-21apt-get00:00:130
99735999371,7cyclictest1089151-21apt-get23:35:110
99735999371,7cyclictest1026915-21users20:30:270
99735999371,6cyclictest1086317-21ntp_states23:25:220
99735999371,6cyclictest1058558-21cstates22:05:130
99735999371,5cyclictest1084047-21apt-get23:20:110
99735999371,11cyclictest1106749-21df_inode00:25:140
99735999371,10cyclictest998573-21grep19:10:250
997367993627,6cyclictest0-21swapper/223:05:252
997363993628,4cyclictest0-21swapper/120:30:171
997363993627,5cyclictest0-21swapper/100:10:161
997363993625,7cyclictest1011308-21grep19:45:251
997363993624,7cyclictest1075268-21sh22:55:001
99735999362,5cyclictest1050785-21unixbench_singl21:40:260
99735999361,7cyclictest1081636-21tail23:10:290
99735999361,10cyclictest1019408-21/usr/sbin/munin20:10:230
997367993527,4cyclictest0-21swapper/223:10:162
997367993526,6cyclictest0-21swapper/221:20:272
997367993525,6cyclictest0-21swapper/223:00:272
997367993524,6cyclictest0-21swapper/222:35:012
997367993524,6cyclictest0-21swapper/222:35:002
997363993527,5cyclictest1019330-21runrttasks20:10:221
997363993515,13cyclictest131rcu_preempt23:25:231
997363993511,8cyclictest24-21ksoftirqd/121:50:001
997372993426,4cyclictest0-21swapper/300:25:003
997372993425,5cyclictest1058015-21cron22:05:013
997367993426,5cyclictest0-21swapper/221:55:002
997363993424,6cyclictest0-21swapper/122:40:001
997363993419,9cyclictest131rcu_preempt23:36:391
997372993324,5cyclictest0-21swapper/321:10:183
99737299331,12cyclictest1108210-21wc00:30:013
99736799335,5cyclictest131rcu_preempt20:30:142
997367993323,6cyclictest0-21swapper/223:25:282
997367993323,6cyclictest0-21swapper/222:25:292
997367993323,6cyclictest0-21swapper/222:25:292
997367993320,9cyclictest0-21swapper/223:45:172
997367993320,9cyclictest0-21swapper/223:45:172
99736399336,7cyclictest24-21ksoftirqd/120:25:261
997363993320,5cyclictest131rcu_preempt21:17:001
997372993224,5cyclictest1006155-21grep19:30:253
997372993224,5cyclictest1006155-21grep19:30:253
997372993224,4cyclictest0-21swapper/300:35:253
997372993223,6cyclictest1056298-21sh22:00:003
997372993222,7cyclictest1065069-21munin-run22:25:003
99737299321,2cyclictest0-21swapper/320:00:123
997367993225,4cyclictest0-21swapper/223:20:262
997367993224,4cyclictest0-21swapper/222:00:152
997367993223,5cyclictest0-21swapper/221:25:272
997367993223,5cyclictest0-21swapper/221:00:252
99736399329,7cyclictest24-21ksoftirqd/122:35:011
99736399329,7cyclictest24-21ksoftirqd/122:35:001
99736399328,8cyclictest24-21ksoftirqd/121:00:021
99736399328,7cyclictest24-21ksoftirqd/120:00:011
997363993221,4cyclictest131rcu_preempt00:22:541
997363993218,3cyclictest131rcu_preempt00:10:001
997363993216,9cyclictest131rcu_preempt22:48:171
997363993214,9cyclictest131rcu_preempt23:50:141
997363993210,8cyclictest24-21ksoftirqd/121:55:221
997367993123,5cyclictest0-21swapper/223:00:012
997367993122,6cyclictest0-21swapper/222:00:002
997367993122,6cyclictest0-21swapper/219:25:012
997367993122,6cyclictest0-21swapper/219:25:012
997367993119,8cyclictest1040479-21grep21:10:272
997367993119,8cyclictest1033702-21grep20:50:272
99736399316,6cyclictest24-21ksoftirqd/119:50:241
99736399315,5cyclictest24-21ksoftirqd/120:35:251
99736399315,5cyclictest24-21ksoftirqd/120:35:251
99736399314,8cyclictest24-21ksoftirqd/122:30:001
99736399314,8cyclictest24-21ksoftirqd/122:30:001
99736399314,7cyclictest24-21ksoftirqd/123:40:241
997363993124,3cyclictest0-21swapper/100:15:161
997363993121,6cyclictest0-21swapper/121:10:001
997363993117,9cyclictest131rcu_preempt21:00:081
997363993116,9cyclictest131rcu_preempt22:57:501
997363993115,9cyclictest131rcu_preempt00:35:131
997363993113,11cyclictest131rcu_preempt21:12:481
99736399311,19cyclictest0-21swapper/119:25:231
99736399311,19cyclictest0-21swapper/119:25:231
997363993111,3cyclictest131rcu_preempt21:25:231
997363993111,3cyclictest131rcu_preempt20:09:491
997372993023,3cyclictest0-21swapper/320:40:003
997372993023,3cyclictest0-21swapper/320:40:003
997372993022,4cyclictest0-21swapper/323:05:253
997372993022,4cyclictest0-21swapper/320:05:253
997372993021,4cyclictest0-21swapper/321:40:253
99737299301,4cyclictest131rcu_preempt22:35:113
997367993023,5cyclictest1011652-21kworker/u8:0+events_unbound20:01:072
997367993023,4cyclictest0-21swapper/222:15:012
997367993023,3cyclictest0-21swapper/220:10:262
997367993022,4cyclictest0-21swapper/221:20:012
997367993022,4cyclictest0-21swapper/220:45:242
997367993021,5cyclictest0-21swapper/220:55:282
997367993020,6cyclictest0-21swapper/222:35:252
997367993020,6cyclictest0-21swapper/219:30:252
997367993020,6cyclictest0-21swapper/219:30:242
997367993020,5cyclictest0-21swapper/220:05:162
99736399307,7cyclictest24-21ksoftirqd/100:00:201
997363993022,4cyclictest0-21swapper/122:20:011
997363993021,6cyclictest231ktimers/120:40:221
997363993019,4cyclictest131rcu_preempt23:10:121
997363993015,3cyclictest131rcu_preempt22:20:271
997363993012,11cyclictest131rcu_preempt21:20:151
997363993011,11cyclictest997354-21cyclictest21:40:221
997372992922,5cyclictest1042309-21kworker/u8:0+events_unbound22:14:073
997372992922,5cyclictest1011652-21kworker/u8:0+events_unbound19:50:223
997372992922,3cyclictest0-21swapper/323:55:003
997372992920,6cyclictest0-21swapper/300:20:003
997367992923,3cyclictest1004718-21kthreadd19:30:002
997367992923,3cyclictest1004718-21kthreadd19:30:002
997367992921,5cyclictest0-21swapper/222:25:002
997367992921,5cyclictest0-21swapper/220:00:012
997367992920,6cyclictest0-21swapper/200:10:012
997367992919,6cyclictest0-21swapper/219:50:002
997367992918,7cyclictest0-21swapper/200:36:282
99736399294,6cyclictest24-21ksoftirqd/119:15:021
997363992921,4cyclictest0-21swapper/119:40:161
997363992919,7cyclictest231ktimers/123:30:231
99736399291,8cyclictest24-21ksoftirqd/121:35:011
997363992918,8cyclictest231ktimers/119:30:321
997363992918,8cyclictest231ktimers/119:30:321
997363992918,5cyclictest131rcu_preempt22:41:561
997363992914,4cyclictest131rcu_preempt23:55:591
997363992912,4cyclictest131rcu_preempt22:10:101
997363992912,3cyclictest131rcu_preempt23:19:521
997363992911,11cyclictest131rcu_preempt23:08:001
997372992822,4cyclictest1061390-21kworker/u8:1+events_unbound22:47:103
997372992822,4cyclictest1048646-21wc21:35:283
997372992820,5cyclictest1085961-21fschecks_time23:25:153
997372992819,4cyclictest0-21swapper/319:35:263
997367992820,5cyclictest0-21swapper/223:35:002
997367992820,5cyclictest0-21swapper/223:20:002
997367992819,6cyclictest1049947-21fschecks_time21:40:172
997367992818,6cyclictest0-21swapper/222:20:002
99736399284,13cyclictest24-21ksoftirqd/120:15:151
997363992821,4cyclictest231ktimers/121:35:141
997363992820,4cyclictest0-21swapper/100:30:261
997363992819,6cyclictest231ktimers/120:45:181
997363992814,5cyclictest131rcu_preempt19:20:141
997363992814,5cyclictest131rcu_preempt19:20:141
997363992814,3cyclictest131rcu_preempt22:07:411
997363992810,10cyclictest221rcuc/123:20:221
99737299272,4cyclictest131rcu_preempt19:25:133
99737299272,4cyclictest131rcu_preempt19:25:133
997372992721,4cyclictest1090859-21kworker/u8:1+events_unbound00:03:313
997372992720,4cyclictest0-21swapper/321:55:003
997372992720,3cyclictest0-21swapper/320:45:273
997372992719,5cyclictest0-21swapper/323:20:013
997372992719,4cyclictest0-21swapper/323:45:263
997372992719,4cyclictest0-21swapper/323:45:263
997372992719,4cyclictest0-21swapper/321:25:233
997372992719,4cyclictest0-21swapper/300:10:243
99737299271,3cyclictest1046313-21apt-get21:30:133
997367992721,4cyclictest32-21ksoftirqd/223:40:112
997367992720,5cyclictest1011652-21kworker/u8:0+events_unbound20:41:092
997367992718,4cyclictest0-21swapper/222:46:182
99736399274,8cyclictest24-21ksoftirqd/120:00:261
99736399273,6cyclictest24-21ksoftirqd/120:20:281
997363992713,3cyclictest131rcu_preempt00:25:191
997372992620,3cyclictest0-21swapper/323:10:263
997372992619,5cyclictest1064915-21kworker/u8:2+events_unbound23:20:403
997372992619,3cyclictest0-21swapper/321:00:163
997372992617,6cyclictest1090160-21grep23:35:253
997367992619,3cyclictest0-21swapper/222:10:012
997367992617,6cyclictest0-21swapper/200:29:592
997367992616,6cyclictest0-21swapper/221:05:212
99737299255,4cyclictest131rcu_preempt21:05:253
997372992519,3cyclictest1059939-21kthreadd22:10:013
997372992519,3cyclictest0-21swapper/323:55:253
997372992518,4cyclictest0-21swapper/319:20:253
997372992518,4cyclictest0-21swapper/319:20:243
997372992516,6cyclictest1042209-21unixbench_multi21:15:263
997372992514,8cyclictest1075674-21cut22:55:163
997367992519,4cyclictest1042309-21kworker/u8:0+events_unbound22:41:192
997367992517,5cyclictest1042309-21kworker/u8:0+events_unbound21:30:142
997367992516,6cyclictest0-21swapper/223:40:002
997367992516,5cyclictest0-21swapper/200:00:002
997372992418,4cyclictest1073388-21kworker/u8:3+events_unbound22:53:083
997372992418,4cyclictest1033595-21kworker/u8:1+events_unbound20:50:293
997372992418,4cyclictest1027281-21kworker/u8:1+events_unbound20:44:063
997372992417,5cyclictest997017-21kworker/u8:0+events_unbound19:12:333
997372992417,3cyclictest0-21swapper/323:40:153
997372992416,4cyclictest0-21swapper/319:55:253
997372992415,5cyclictest1078232-21grep23:00:273
99737299241,4cyclictest0-21swapper/322:30:233
99737299241,4cyclictest0-21swapper/322:30:233
997367992419,2cyclictest0-21swapper/221:35:292
997367992418,3cyclictest0-21swapper/200:20:002
997367992416,5cyclictest0-21swapper/220:35:272
997367992416,5cyclictest0-21swapper/220:35:262
997367992415,6cyclictest0-21swapper/221:45:252
997367992413,8cyclictest1098465-21cat00:00:232
997367992410,11cyclictest1108499-21cut00:30:172
99737299236,5cyclictest131rcu_preempt00:05:293
997372992313,6cyclictest391ktimers/319:45:003
997367992317,3cyclictest0-21swapper/220:25:202
997372992215,5cyclictest1035442-21kworker/u8:3+events_unbound20:57:213
997372992215,4cyclictest1065292-21/usr/sbin/munin22:25:233
997372992215,4cyclictest1065292-21/usr/sbin/munin22:25:233
997372992212,7cyclictest1025699-21sed20:30:013
99736799222,11cyclictest131rcu_preempt23:50:202
997367992216,3cyclictest0-21swapper/219:35:182
997367992215,3cyclictest0-21swapper/200:20:162
997372992115,3cyclictest0-21swapper/322:40:173
99737299211,4cyclictest0-21swapper/319:45:243
997367992114,4cyclictest0-21swapper/219:15:042
997367992113,6cyclictest1006857-21kworker/u8:2+events_unbound19:41:032
997367992113,5cyclictest0-21swapper/200:10:252
99737299201,4cyclictest0-21swapper/321:45:193
997372992012,5cyclictest0-21swapper/320:35:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional